-- Logs begin at Thu 2022-05-12 17:55:53 UTC, end at Thu 2022-05-12 19:19:42 UTC. -- May 12 18:44:42.474856 dv-cinder-795751-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 12 18:44:42.483037 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 18:44:42.485079 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 18:44:42 2022] *** May 12 18:44:42.485079 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 18:44:42.485079 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 18:44:42.485079 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: nodename: dv-cinder-795751-3-iscsi May 12 18:44:42.485079 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: machine: x86_64 May 12 18:44:42.485079 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: clock source: unix May 12 18:44:42.485079 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: pcre jit disabled May 12 18:44:42.485079 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: detected number of CPU cores: 4 May 12 18:44:42.485079 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: current working directory: / May 12 18:44:42.485624 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: detected binary path: /usr/bin/uwsgi-core May 12 18:44:42.485624 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: your processes number limit is 47680 May 12 18:44:42.485624 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: your memory page size is 4096 bytes May 12 18:44:42.485624 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: detected max file descriptor number: 2048 May 12 18:44:42.485624 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: lock engine: pthread robust mutexes May 12 18:44:42.485624 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: thunder lock: enabled May 12 18:44:42.485624 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 18:44:42.485624 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 18:44:42.531480 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: Python main interpreter initialized at 0x5599ae13b9c0 May 12 18:44:42.531480 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: python threads support enabled May 12 18:44:42.531480 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: your server socket listen backlog is limited to 100 connections May 12 18:44:42.531480 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: your mercy for graceful operations on workers is 90 seconds May 12 18:44:42.531874 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: mapped 403077 bytes (393 KB) for 2 cores May 12 18:44:42.531950 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: *** Operational MODE: preforking *** May 12 18:44:42.532262 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: *** uWSGI is running in multiple interpreter mode *** May 12 18:44:42.532262 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: spawned uWSGI master process (pid: 79819) May 12 18:44:42.532477 dv-cinder-795751-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 12 18:44:42.536684 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: spawned uWSGI worker 1 (pid: 79833, cores: 1) May 12 18:44:42.536684 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: spawned uWSGI worker 2 (pid: 79834, cores: 1) May 12 18:44:42.536684 dv-cinder-795751-3-iscsi devstack@keystone.service[79819]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 18:44:48.275903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:44:48.275903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: from cryptography.utils import int_from_bytes May 12 18:44:48.277778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:44:48.277778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: from cryptography.utils import int_from_bytes May 12 18:44:48.283840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:44:48.283840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: from cryptography.utils import int_from_bytes May 12 18:44:48.285172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:44:48.285172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: from cryptography.utils import int_from_bytes May 12 18:44:48.326547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 18:44:48.326793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 18:44:48.326936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] command line args: [] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 18:44:48.327184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 18:44:48.327359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ================================================================================ {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 18:44:48.327616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] admin_token = **** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.327861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] config_dir = [] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.328046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.328225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] config_source = [] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.328402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] debug = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.328595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.329825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.329825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.329825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.330036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.330228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] list_limit = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.330411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] log_config_append = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.330588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.330763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] log_dir = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.330937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] log_file = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.331184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.331415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.331659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.331906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.332103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.332300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.332496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.332723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.332917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.333156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.333348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.333560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 18:44:48.333770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 18:44:48.333939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.334128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] command line args: [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 18:44:48.334337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.334535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 18:44:48.334700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.334876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ================================================================================ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 18:44:48.335042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.335176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] admin_token = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.335176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] config_dir = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.335460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.335602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.335735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] publish_errors = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.335868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] config_source = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.335868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] debug = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.336154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.336299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.336454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.336454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.336703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.336703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.336969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.337103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.337231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.337365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.337545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] standard_threads = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.337694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.337830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.337970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_config_append = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.338102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.338268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.338407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.338540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_dir = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.338685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] use_journal = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.338820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_file = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.338953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] use_json = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.338953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] use_stderr = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.339204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.339337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] use_syslog = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.339473 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.340127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.340307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.340444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.340578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.340710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.340844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.340844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.341093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.341221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.341407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.341625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.341792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.341921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.342054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.342218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.342435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.342639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.342843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.343050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.343247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.343449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.343675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.343886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.344027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.344156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.344338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.344338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.344754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.344962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.345167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] publish_errors = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.345395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.345645 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.345856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.346069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.346289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.346494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.346674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.346825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.346962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.347096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.347236 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.347364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] standard_threads = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.347652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.347872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.348074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.348297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.348297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.348693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.348887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_journal = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.349019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.349147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_json = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.349147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_stderr = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.349387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.349538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] use_syslog = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.349719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.349849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:44:48.349984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.350117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.350244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.350376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.350514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.350648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.350780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.350914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.351048 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.351184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.351322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.351464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.351596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.351724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.351850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.351978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.352112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.352240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.352366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.352491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.352618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.352618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.352867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.353000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.353128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.353270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.353404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.353578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.353723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.353853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.353979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.354105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.354237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.354371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.354573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.354704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.354830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.354958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.355094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.355813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.355964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.356099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.356228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.356355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.356487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.356615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.356750 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.356887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.357015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.357142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.357270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.357406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.357614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.357766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.357905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.358034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.358161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.358297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.358425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.358590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.358744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.358903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.359051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.359196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.359326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.359908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.360117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.360336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.360718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.361017 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.361383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.361734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.362000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.362291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.362502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.362886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.363398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.363754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.363993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.364215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.364416 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.364624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.364789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.364981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.365208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.365375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.365649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.365890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.366051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.366333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.366468 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.366635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.366776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.366958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.367100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.367230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.367367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.367496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.367654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.367796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.367924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.368060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.368190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.368317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.368451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.368580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.368726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.368857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.369014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.369014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.369276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.369412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.369569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.369706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.369836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.369964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.370092 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.370221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.370356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.370356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.370610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.370789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.370934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.371064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.371201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.371330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.371330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.371330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.371330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.371330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.371330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.372113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.372243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.372457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.372610 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.372781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.372918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.373057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.373186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.373313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.373442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.373613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.373758 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.373894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.374025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.374154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.374300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.374435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.374572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.374701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.374829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] auth.external = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.374957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.375086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.375214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.375214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.375474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.375474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.375737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.375866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] auth.password = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.375994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.376175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] auth.token = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.376313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.376451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.376580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.376714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.376850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.376983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.377118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.377256 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.377386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.377514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.377724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.377724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.377979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.377979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.378236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.378365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] credential.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.378492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.378620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.378755 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.378885 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.379013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.379141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.379271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.379405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.379542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.379670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.379835 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.379978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.380114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.380250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.380380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.380508 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.380637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.380773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.380904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.381033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.381162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.381290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.381427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.381584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.381730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.381730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.381974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.382103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.382243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.382374 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.382502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.382502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] federation.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.382751 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.382880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.383016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.383145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.383281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.383422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.383552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.external = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.383680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.383826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.383956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.384086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.384228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.384358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.384488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.384625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.password = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.384755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.384884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] auth.token = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.385018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.385147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.385286 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.385423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.385603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.385739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.385739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.385982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.386111 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.386251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.386381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.386881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.387013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.387277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.387425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.387575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.387708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.387836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.387965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.388206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.388370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.388580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.388713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.388842 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.388972 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.389102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.389230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.389367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.389497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.389662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.389814 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.389945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.390089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.390229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.390360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.390488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.390623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.390753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.390882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.391019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.391019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.391265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.391265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.391523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.391523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.391773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.391773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.392050 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.392178 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.392307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.392434 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.392571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.392700 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.392828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.392957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.393085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.393231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.393368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.393498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.393650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.393781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.393910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.394049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.394180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.394315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.394445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.394573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.394701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.394837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.394977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.395106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.395234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.395363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.395491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.395627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.395756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.395885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.396014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.396143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.396272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.396409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.396539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.396668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.396812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.396941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.397071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.397208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.397343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.397477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.397642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.397774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.397902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.398041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.398172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.398300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.398429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.398558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.398717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.398861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.398999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.399129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.399259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.399387 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.399516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.399516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.399769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.399899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.400027 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.400156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.400286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.400433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.400564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.400693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.400830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.400960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.401088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.401229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.401360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.401489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.401715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.401847 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.401982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.402741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.402900 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.403053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.403189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.403325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.403462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.403606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.403743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.403878 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.404013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.404148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.404283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.404428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.404564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.404699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.404844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.404844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.405100 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.405243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.405380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.405517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.405676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.405812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.405947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.406097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.406234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.406368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.406505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.406647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.406794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.406794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.407060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.407196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.407196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.407463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.407599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.407743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.407880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.407880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.408136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.408270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.408414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.408551 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.408696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.408832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.408967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.409102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.409246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.409382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.409517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.409678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.409813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.409949 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.410095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.410232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.410439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.410620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.410762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.410898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] resource.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.411041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.411177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.411312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.411447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.411583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.411717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.411861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.411997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.412132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.412267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.412402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.412547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.412691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.412878 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.413022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.413158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.413293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.413428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.413632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.413776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] role.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.413912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.414054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] role.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.414190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.414324 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.414467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.414631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.414820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.414990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.415132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.415267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.415478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.415623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.415759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.415895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.416032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.416168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.416311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.416447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.416594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.416731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.416865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.417021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.417228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.417389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.417562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.418277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.418429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.418565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.418713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.418851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.418986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.418986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.419390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.419533 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.419669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.419805 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.419941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.420075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.420211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.420354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.420490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.420626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.420761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.420895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.421297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.421440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.421594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.421737 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.421873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.422007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.422154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.422291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.422427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.422562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.422696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.422831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.422974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.423110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.423256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.423391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.423525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.423660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.423803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.423938 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.424072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.424206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.424342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] role.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.424478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.424620 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] role.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.424756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] token.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.424891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.425040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.425176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.425310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.425453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.425675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.425813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.425948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.426083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.426217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.426363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.426501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.426637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.426771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.426905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.427051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.427195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.427331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.427477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.427613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.427748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.427883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.428026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.428162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.428297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.428433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.428568 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.428703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.428703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.428976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.429111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.429246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.429387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.429576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.429733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.connection = **** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.429878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.430022 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.430158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.430293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.430427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.430562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.430711 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.430860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.430996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.431130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.431265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.431400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.431543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.431681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.431816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.431951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.432086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.432221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.432364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.432508 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.432654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.432791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.432926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.433061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.433205 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.433371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.433509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.433669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.433805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.433940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.434086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.434223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.434359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.434494 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.434639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.434775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.434919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.435056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 18:44:48.435193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.435193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.435193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.435193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.435193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.435193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.435193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.435193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.435193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.436306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.436306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.436306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.436306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.436306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.436306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.436306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.436306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.436306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.437450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.437450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.437450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.437450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.437450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.437450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.437450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.437450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.437450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.438754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.438754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.438754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.438754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.438754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.438754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.438754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:44:48.438754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 18:44:48.444559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.444789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.445011 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.448277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.448511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.448732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.453851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.457593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.482926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.483155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.484725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.484957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.535773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.536019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.587049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.587337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.587494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.587639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.654385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.654385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.654385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.655145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.655145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.655711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.657000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.657230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.657491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.657769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.658050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.658199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.679308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.679547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.679712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.679860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.680004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.680146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.680288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.680438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.680580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.680722 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.680861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.681000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.681159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.681159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.691731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.692245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.706806 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.707069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.707216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.707360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.707500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.707639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.707786 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.707926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.707926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.708204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.708343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.708492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.708492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.708492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 18:44:48.725553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.725772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 18:44:48.726061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.726224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.726367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 18:44:48.726518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 18:44:48.726518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.726781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.726781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 18:44:48.727052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.727052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.727315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.727454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.727592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.727592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.727864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.738220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.738489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.738703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.738854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.739007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.739148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.739287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.739494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.747118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.747680 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.750402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.750679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.750956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.751102 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.751254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.751393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.751533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.751672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.751844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.751997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.752146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.752286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.752435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.752575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.752720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.752871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.753012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.753150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.753289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.753427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.753427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.753734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.780692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.781141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.782355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.782631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.782794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.783052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.788111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.788397 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.788544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.788703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.788844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.789001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.796562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.796836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.796999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.797140 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.801638 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.801856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.802002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.802141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.802296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.802456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.802731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.802894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.803038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.803194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.803336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.803475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.803614 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.803752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.803899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.804041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.822018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.822290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.822439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.822706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.827300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.827770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.830900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.831191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.831440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.831733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.836117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.836753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.840240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.840925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.843943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.844236 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.844517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.844703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.844853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.845077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.845231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.845372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.845512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.845695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.845846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.846088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.864279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.864648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.864912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.865156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.865317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.865559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.865817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.866082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.873046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.874003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.874783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.875052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.875720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.875994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.878109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.878387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.878659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.878943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.879091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.879231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.879382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.879588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.879865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.880140 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.893058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.893333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.893635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.893922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.894071 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.894223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.894364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.894503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.894642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.894789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.894938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.895148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.895427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.895696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.913355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.914225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.916829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.917490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.920258 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.920836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.922115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.923531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.923735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.924008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.924307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.925193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.925471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.925812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.931695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.933302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.933392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.934998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.936536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.936819 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.937107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.937377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.938260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.938551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.938862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.939142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.946583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.946865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.947138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.948395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.948700 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.949480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.957247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.957543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.957753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 18:44:48.957839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.958032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.958118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.958315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.958412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.958588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.958671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.958861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.958948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.959127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.959208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.959389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.959484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.959709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.959792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.959955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.960035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.960204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.960298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.960493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.960575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.960735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.960816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.961022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:48.961299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 18:44:49.000068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599ae13b9c0 pid: 79834 (default app) May 12 18:44:49.001226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599ae13b9c0 pid: 79833 (default app) May 12 18:44:49.003398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818fb85-f5bb-47fb-89ee-2340e927726d None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:44:49.003693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818fb85-f5bb-47fb-89ee-2340e927726d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:44:49.003972 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818fb85-f5bb-47fb-89ee-2340e927726d None None] PATH_INFO: `/v3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:44:49.008128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu May 12 18:44:49 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:44:56.953339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ccaff-5638-43ed-a190-c9f7c23011cc None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:44:56.953933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ccaff-5638-43ed-a190-c9f7c23011cc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:44:56.953933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ccaff-5638-43ed-a190-c9f7c23011cc None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:44:56.958240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:44:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:44:56.963252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:44:56.963649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:44:56.963810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:44:56.995251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG oslo_db.sqlalchemy.engines [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:44:57.178338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG passlib.handlers.bcrypt [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79834) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 18:44:57.178751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG passlib.handlers.bcrypt [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79834) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 18:44:57.233901 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:44:57.235446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:44:57.357706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:44:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 12 18:44:57.501191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ccaff-5638-43ed-a190-c9f7c23011cc None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:44:57.534260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG oslo_db.sqlalchemy.engines [None req-003ccaff-5638-43ed-a190-c9f7c23011cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:44:57.666455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ccaff-5638-43ed-a190-c9f7c23011cc None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:44:57.670720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f2531-b342-495f-ad54-742894895c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:44:57.671649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f2531-b342-495f-ad54-742894895c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:44:57.671933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f2531-b342-495f-ad54-742894895c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:44:57.672211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f2531-b342-495f-ad54-742894895c70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:44:57.680175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f2531-b342-495f-ad54-742894895c70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:44:57.731558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WARNING keystone.common.rbac_enforcer.enforcer [None req-976f2531-b342-495f-ad54-742894895c70 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 18:44:57.731900 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f2531-b342-495f-ad54-742894895c70 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:44:57.741257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu May 12 18:44:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 18:44:57.747523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:44:57.762156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa38c-565e-46cd-94af-55111e80c362 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:44:57.766446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba75ebd-8088-4d10-aab9-ebedca7373e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:44:57.767564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba75ebd-8088-4d10-aab9-ebedca7373e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:44:57.767848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba75ebd-8088-4d10-aab9-ebedca7373e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:44:57.768121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba75ebd-8088-4d10-aab9-ebedca7373e8 admin admin] PATH_INFO: `/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:44:57.769662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba75ebd-8088-4d10-aab9-ebedca7373e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=039d8e8cc62f44a2bdf4d5f5334c1312)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:44:57.819783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fba75ebd-8088-4d10-aab9-ebedca7373e8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 18:44:57.820125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba75ebd-8088-4d10-aab9-ebedca7373e8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:44:57.825230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu May 12 18:44:57 2022] GET /identity/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:00.017948 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1ad7-adc8-4438-a6b9-b413b4aa4962 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:00.018512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1ad7-adc8-4438-a6b9-b413b4aa4962 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:00.018512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1ad7-adc8-4438-a6b9-b413b4aa4962 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:00.022662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:00.028452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60a68-35fb-4c8b-84fd-62dfc59ca977 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:00.028884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60a68-35fb-4c8b-84fd-62dfc59ca977 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:00.029016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60a68-35fb-4c8b-84fd-62dfc59ca977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:00.049456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2be60a68-35fb-4c8b-84fd-62dfc59ca977 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:00.051034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2be60a68-35fb-4c8b-84fd-62dfc59ca977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:00.058749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 18:45:00.079951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c1ad7-adc8-4438-a6b9-b413b4aa4962 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:00.092372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c1ad7-adc8-4438-a6b9-b413b4aa4962 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:00.096588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d126687-3be3-4e46-8cd3-4a8ff285535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:00.097220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d126687-3be3-4e46-8cd3-4a8ff285535e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:00.097506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d126687-3be3-4e46-8cd3-4a8ff285535e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:00.097816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d126687-3be3-4e46-8cd3-4a8ff285535e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:00.106007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d126687-3be3-4e46-8cd3-4a8ff285535e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:00.107773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d126687-3be3-4e46-8cd3-4a8ff285535e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:00.116443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu May 12 18:45:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 18:45:00.121971 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60a68-35fb-4c8b-84fd-62dfc59ca977 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:00.131392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60a68-35fb-4c8b-84fd-62dfc59ca977 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:00.135751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a864a6-9c59-440d-ad93-650973c00330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:00.136615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a864a6-9c59-440d-ad93-650973c00330 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:00.136897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a864a6-9c59-440d-ad93-650973c00330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:00.137170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a864a6-9c59-440d-ad93-650973c00330 admin admin] PATH_INFO: `/v3/users/39e02c8648054bf7b77e58c3e22a7e1e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:00.138606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a864a6-9c59-440d-ad93-650973c00330 admin admin] RBAC: Authorizing `identity:get_user(user_id=39e02c8648054bf7b77e58c3e22a7e1e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:00.140425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a864a6-9c59-440d-ad93-650973c00330 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:00.142062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu May 12 18:45:00 2022] GET /identity/v3/users/39e02c8648054bf7b77e58c3e22a7e1e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:02.404759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330ed8-0bd2-4e55-985a-9966567da96e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:02.405280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330ed8-0bd2-4e55-985a-9966567da96e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:02.405280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330ed8-0bd2-4e55-985a-9966567da96e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:02.406628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:45:02.411811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17059e43-1a16-4a8c-aebc-51d1cb420bd4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:02.412245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17059e43-1a16-4a8c-aebc-51d1cb420bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:02.412347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17059e43-1a16-4a8c-aebc-51d1cb420bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:02.420490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38245b-4e06-49c1-b083-7528259b1755 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:02.420779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38245b-4e06-49c1-b083-7528259b1755 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:02.421058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38245b-4e06-49c1-b083-7528259b1755 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:02.422797 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:45:02.428024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697430-1559-4450-b33b-3758c1490430 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:02.428305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697430-1559-4450-b33b-3758c1490430 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:02.428578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697430-1559-4450-b33b-3758c1490430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:02.470372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG passlib.handlers.bcrypt [None req-77697430-1559-4450-b33b-3758c1490430 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79833) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 18:45:02.470796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG passlib.handlers.bcrypt [None req-77697430-1559-4450-b33b-3758c1490430 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79833) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 18:45:02.522068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-77697430-1559-4450-b33b-3758c1490430 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:02.523695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-77697430-1559-4450-b33b-3758c1490430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:02.541260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-17059e43-1a16-4a8c-aebc-51d1cb420bd4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:02.542474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-17059e43-1a16-4a8c-aebc-51d1cb420bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:02.620097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:02.626965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:02.643221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17059e43-1a16-4a8c-aebc-51d1cb420bd4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:02.648153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697430-1559-4450-b33b-3758c1490430 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:02.738649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17059e43-1a16-4a8c-aebc-51d1cb420bd4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:02.743642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697430-1559-4450-b33b-3758c1490430 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:02.771016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be1bb3-db54-439b-aad2-00b92a187c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:02.771798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be1bb3-db54-439b-aad2-00b92a187c41 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:02.772080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be1bb3-db54-439b-aad2-00b92a187c41 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:02.772366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be1bb3-db54-439b-aad2-00b92a187c41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:02.775576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa3d4-536d-4d33-91eb-8497311a121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:02.776456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa3d4-536d-4d33-91eb-8497311a121e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:02.776742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa3d4-536d-4d33-91eb-8497311a121e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:02.777045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa3d4-536d-4d33-91eb-8497311a121e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:02.783102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be1bb3-db54-439b-aad2-00b92a187c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-17be1bb3-db54-439b-aad2-00b92a187c41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:02.794789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:02.795960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:02.797307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:02.801954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be1bb3-db54-439b-aad2-00b92a187c41 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:02.849148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fa3d4-536d-4d33-91eb-8497311a121e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:02.850716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fa3d4-536d-4d33-91eb-8497311a121e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:02.894572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be1bb3-db54-439b-aad2-00b92a187c41 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:02.927417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb099d69-34de-4adb-aae8-a4c5cfc18dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:02.928065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb099d69-34de-4adb-aae8-a4c5cfc18dfd None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:02.928347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb099d69-34de-4adb-aae8-a4c5cfc18dfd None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:02.928616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb099d69-34de-4adb-aae8-a4c5cfc18dfd None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:02.929353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb099d69-34de-4adb-aae8-a4c5cfc18dfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:02.929689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb099d69-34de-4adb-aae8-a4c5cfc18dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:02.931063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb099d69-34de-4adb-aae8-a4c5cfc18dfd None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:02.942339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:02.944551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:45:02.947667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb099d69-34de-4adb-aae8-a4c5cfc18dfd None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:02.950105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa3d4-536d-4d33-91eb-8497311a121e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:03.051871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb099d69-34de-4adb-aae8-a4c5cfc18dfd None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:03.085990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62ae0a-3007-47f2-b379-8df69bea290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:03.086852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62ae0a-3007-47f2-b379-8df69bea290f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:03.087186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62ae0a-3007-47f2-b379-8df69bea290f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:03.087467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62ae0a-3007-47f2-b379-8df69bea290f None admin] PATH_INFO: `/v3/users/39e02c8648054bf7b77e58c3e22a7e1e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:03.088667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62ae0a-3007-47f2-b379-8df69bea290f None admin] RBAC: Authorizing `identity:get_user(user_id=39e02c8648054bf7b77e58c3e22a7e1e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:03.090666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62ae0a-3007-47f2-b379-8df69bea290f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:03.092260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:02 2022] GET /identity/v3/users/39e02c8648054bf7b77e58c3e22a7e1e => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:03.097502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62ae0a-3007-47f2-b379-8df69bea290f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:03.153190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa3d4-536d-4d33-91eb-8497311a121e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:03.185707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a60ef2-a1c2-476e-abb9-343e40054a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:03.186494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60ef2-a1c2-476e-abb9-343e40054a59 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:03.186839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60ef2-a1c2-476e-abb9-343e40054a59 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:03.187118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60ef2-a1c2-476e-abb9-343e40054a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:03.192610 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62ae0a-3007-47f2-b379-8df69bea290f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:03.204869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a60ef2-a1c2-476e-abb9-343e40054a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:03.206423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a60ef2-a1c2-476e-abb9-343e40054a59 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:03.225079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241028a-cff5-4d68-8150-8df886d9ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:03.225898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241028a-cff5-4d68-8150-8df886d9ff15 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:03.226215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241028a-cff5-4d68-8150-8df886d9ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:03.226493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241028a-cff5-4d68-8150-8df886d9ff15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-34a60ef2-a1c2-476e-abb9-343e40054a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:45:03.227171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:03.228151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:03.229177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:45:03.229177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:45:03.229177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:45:03.229177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:03.229456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241028a-cff5-4d68-8150-8df886d9ff15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:03.229578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:03.230834 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241028a-cff5-4d68-8150-8df886d9ff15 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:03.232456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:03.234880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a60ef2-a1c2-476e-abb9-343e40054a59 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:03.237883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241028a-cff5-4d68-8150-8df886d9ff15 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:03.329978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a60ef2-a1c2-476e-abb9-343e40054a59 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:03.331403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241028a-cff5-4d68-8150-8df886d9ff15 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:03.362323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e99a6-5806-4219-8a24-521b329171b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:03.362985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e99a6-5806-4219-8a24-521b329171b3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:03.363275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e99a6-5806-4219-8a24-521b329171b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:03.363443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f735a3d-a7ee-450f-b876-9862904918df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:03.363546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e99a6-5806-4219-8a24-521b329171b3 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:03.364097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f735a3d-a7ee-450f-b876-9862904918df None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:03.364278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e99a6-5806-4219-8a24-521b329171b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:03.364366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f735a3d-a7ee-450f-b876-9862904918df None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:03.364591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e99a6-5806-4219-8a24-521b329171b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:03.364677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f735a3d-a7ee-450f-b876-9862904918df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:03.365451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f735a3d-a7ee-450f-b876-9862904918df None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.domain.id=default, user.id=39e02c8648054bf7b77e58c3e22a7e1e) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:03.365792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f735a3d-a7ee-450f-b876-9862904918df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:03.366031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e99a6-5806-4219-8a24-521b329171b3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:03.367214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f735a3d-a7ee-450f-b876-9862904918df None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:03.373966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Thu May 12 18:45:03 2022] GET /identity/v3/role_assignments?user.id=39e02c8648054bf7b77e58c3e22a7e1e&scope.domain.id=default&role.id=d03e020b3fb34446bbf5893b28904483 => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:03.383833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:06.169391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8fea0-0a3e-42f3-bb02-3143a17815ae None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:06.170047 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8fea0-0a3e-42f3-bb02-3143a17815ae None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:06.170047 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8fea0-0a3e-42f3-bb02-3143a17815ae None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:06.171867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:06.178770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde68b6-84ae-4732-b9ed-dbb1954afab3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:06.179888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde68b6-84ae-4732-b9ed-dbb1954afab3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:06.180557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde68b6-84ae-4732-b9ed-dbb1954afab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:06.215405 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5cde68b6-84ae-4732-b9ed-dbb1954afab3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:06.217432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5cde68b6-84ae-4732-b9ed-dbb1954afab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:06.327199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:06.353117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8fea0-0a3e-42f3-bb02-3143a17815ae None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:06.504153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5bc4-f677-4f2c-8d20-b2684be3eafa None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:06.504510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5bc4-f677-4f2c-8d20-b2684be3eafa None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:06.504724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5bc4-f677-4f2c-8d20-b2684be3eafa None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:06.507001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:45:06.513702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b3a1d-d9a7-4f52-872c-7d0d6ff9c18c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:06.513990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b3a1d-d9a7-4f52-872c-7d0d6ff9c18c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:06.514278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b3a1d-d9a7-4f52-872c-7d0d6ff9c18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:06.536601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a57b3a1d-d9a7-4f52-872c-7d0d6ff9c18c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:06.537858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a57b3a1d-d9a7-4f52-872c-7d0d6ff9c18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:06.547437 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8fea0-0a3e-42f3-bb02-3143a17815ae None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:06.621114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568edc33-26a8-4823-ab5e-8d66f6c9e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:06.621954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edc33-26a8-4823-ab5e-8d66f6c9e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:06.622243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edc33-26a8-4823-ab5e-8d66f6c9e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:06.622522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edc33-26a8-4823-ab5e-8d66f6c9e1e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:06.646524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568edc33-26a8-4823-ab5e-8d66f6c9e1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-568edc33-26a8-4823-ab5e-8d66f6c9e1e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:06.661785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:06.663102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:06.664252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:06.665133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 13/25] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:06.671018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568edc33-26a8-4823-ab5e-8d66f6c9e1e6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:06.678955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:06.680389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b184-b551-453d-b794-6c453c101e6b None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:06.680683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b184-b551-453d-b794-6c453c101e6b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:06.680960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b184-b551-453d-b794-6c453c101e6b None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:06.689803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:06.694261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03f44a-a413-4ea0-bf11-bc5bef5667c1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:06.694549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03f44a-a413-4ea0-bf11-bc5bef5667c1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:06.694828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03f44a-a413-4ea0-bf11-bc5bef5667c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:06.747222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1d03f44a-a413-4ea0-bf11-bc5bef5667c1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:06.748449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1d03f44a-a413-4ea0-bf11-bc5bef5667c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:06.800646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568edc33-26a8-4823-ab5e-8d66f6c9e1e6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:06.836415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73444c9b-7d2f-473b-93e1-ad265f535593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:06.837088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444c9b-7d2f-473b-93e1-ad265f535593 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:06.837378 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444c9b-7d2f-473b-93e1-ad265f535593 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:06.837693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444c9b-7d2f-473b-93e1-ad265f535593 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:06.838448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73444c9b-7d2f-473b-93e1-ad265f535593 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:06.838758 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73444c9b-7d2f-473b-93e1-ad265f535593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:06.840183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73444c9b-7d2f-473b-93e1-ad265f535593 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:06.849294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 14/28] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:06.854388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73444c9b-7d2f-473b-93e1-ad265f535593 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:06.911156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 15/29] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:06.912329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03f44a-a413-4ea0-bf11-bc5bef5667c1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:06.962682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73444c9b-7d2f-473b-93e1-ad265f535593 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:06.996710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ce5f9-0284-4902-bb61-e67e081c88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:06.997381 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce5f9-0284-4902-bb61-e67e081c88e2 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:06.997702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce5f9-0284-4902-bb61-e67e081c88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:06.997984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce5f9-0284-4902-bb61-e67e081c88e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:06.998729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ce5f9-0284-4902-bb61-e67e081c88e2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:07.000111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ce5f9-0284-4902-bb61-e67e081c88e2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:07.040576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03f44a-a413-4ea0-bf11-bc5bef5667c1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:07.078600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100c5fa-4ea6-43db-9077-b6c8d0122596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:07.079472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100c5fa-4ea6-43db-9077-b6c8d0122596 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.079761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100c5fa-4ea6-43db-9077-b6c8d0122596 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.080042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100c5fa-4ea6-43db-9077-b6c8d0122596 None admin] PATH_INFO: `/v3/users/39e02c8648054bf7b77e58c3e22a7e1e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.081792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100c5fa-4ea6-43db-9077-b6c8d0122596 None admin] RBAC: Authorizing `identity:get_user(user_id=39e02c8648054bf7b77e58c3e22a7e1e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:07.083275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100c5fa-4ea6-43db-9077-b6c8d0122596 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:07.085238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 16/30] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:06 2022] GET /identity/v3/users/39e02c8648054bf7b77e58c3e22a7e1e => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:07.086622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332638-d2c7-4da1-bfaa-ea09f741900d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.087113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332638-d2c7-4da1-bfaa-ea09f741900d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.087403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332638-d2c7-4da1-bfaa-ea09f741900d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.089009 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 17/31] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:07.089810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a332638-d2c7-4da1-bfaa-ea09f741900d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:07.170193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 15/32] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 12 18:45:06 2022] POST /identity/v3/roles => generated 225 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:07.173555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb5d4-98d5-4ed7-9d51-062aa0bfa40c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.173555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb5d4-98d5-4ed7-9d51-062aa0bfa40c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.173555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb5d4-98d5-4ed7-9d51-062aa0bfa40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.213208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e99fb5d4-98d5-4ed7-9d51-062aa0bfa40c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:07.214874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e99fb5d4-98d5-4ed7-9d51-062aa0bfa40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:07.225350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a332638-d2c7-4da1-bfaa-ea09f741900d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:07.278384 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f30cc-895c-42f9-b401-6986679427e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:07.279202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f30cc-895c-42f9-b401-6986679427e8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.279487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f30cc-895c-42f9-b401-6986679427e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.279765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f30cc-895c-42f9-b401-6986679427e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.291100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f30cc-895c-42f9-b401-6986679427e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:07.293279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f30cc-895c-42f9-b401-6986679427e8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:07.310158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:07.311037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb5d4-98d5-4ed7-9d51-062aa0bfa40c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-735f30cc-895c-42f9-b401-6986679427e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:45:07.313661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:07.314474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:07.315342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:45:07.315342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:45:07.315342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:45:07.315342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:07.315546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 18/34] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:07.316910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0e99-b143-4420-8c54-ca4efc706310 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.317164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0e99-b143-4420-8c54-ca4efc706310 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.317728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0e99-b143-4420-8c54-ca4efc706310 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.319539 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 19/35] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:07.325350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d330-8815-49f5-b45c-af86ea31da24 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.325646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d330-8815-49f5-b45c-af86ea31da24 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.325895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d330-8815-49f5-b45c-af86ea31da24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.343934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7ac1d330-8815-49f5-b45c-af86ea31da24 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:07.345080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7ac1d330-8815-49f5-b45c-af86ea31da24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:07.426699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb5d4-98d5-4ed7-9d51-062aa0bfa40c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:07.427361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 20/36] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:07.428330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1d330-8815-49f5-b45c-af86ea31da24 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:07.468374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863226-1a78-4e29-b97a-678ea7f744c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:07.469184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863226-1a78-4e29-b97a-678ea7f744c3 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.469466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863226-1a78-4e29-b97a-678ea7f744c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.469779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863226-1a78-4e29-b97a-678ea7f744c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.471467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8863226-1a78-4e29-b97a-678ea7f744c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:07.472566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8863226-1a78-4e29-b97a-678ea7f744c3 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:07.475698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 17/37] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:07.476476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863226-1a78-4e29-b97a-678ea7f744c3 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:07.552272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1d330-8815-49f5-b45c-af86ea31da24 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:07.594331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff199449-869a-456f-8fcf-f75ae52270b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:07.594559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863226-1a78-4e29-b97a-678ea7f744c3 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:07.595897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199449-869a-456f-8fcf-f75ae52270b8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.596554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199449-869a-456f-8fcf-f75ae52270b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.596982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199449-869a-456f-8fcf-f75ae52270b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.598141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff199449-869a-456f-8fcf-f75ae52270b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:07.598582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff199449-869a-456f-8fcf-f75ae52270b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:07.600707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff199449-869a-456f-8fcf-f75ae52270b8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:07.621100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 21/38] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:07.621100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff199449-869a-456f-8fcf-f75ae52270b8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:07.633026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dd64-1db6-420a-8866-bc373de4b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:07.633733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dd64-1db6-420a-8866-bc373de4b145 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.634020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dd64-1db6-420a-8866-bc373de4b145 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.634304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dd64-1db6-420a-8866-bc373de4b145 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.635055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973dd64-1db6-420a-8866-bc373de4b145 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:07.636480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973dd64-1db6-420a-8866-bc373de4b145 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:07.649639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 18/39] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 12 18:45:07 2022] POST /identity/v3/roles => generated 219 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:07.650680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dd64-1db6-420a-8866-bc373de4b145 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:07.758811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff199449-869a-456f-8fcf-f75ae52270b8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:07.781706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dd64-1db6-420a-8866-bc373de4b145 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:07.805890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eeb1f-3943-42f7-98c3-1d2f48abb442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:07.807235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eeb1f-3943-42f7-98c3-1d2f48abb442 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.807967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eeb1f-3943-42f7-98c3-1d2f48abb442 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.808476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eeb1f-3943-42f7-98c3-1d2f48abb442 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.809627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eeb1f-3943-42f7-98c3-1d2f48abb442 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:07.811816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eeb1f-3943-42f7-98c3-1d2f48abb442 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:07.818380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8fd58-4fb6-4ad5-832b-ab2618c06ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:07.819113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8fd58-4fb6-4ad5-832b-ab2618c06ba0 None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:07.819462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8fd58-4fb6-4ad5-832b-ab2618c06ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:07.820106 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8fd58-4fb6-4ad5-832b-ab2618c06ba0 None admin] PATH_INFO: `/v3/domains/default/users/39e02c8648054bf7b77e58c3e22a7e1e/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:07.822490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8fd58-4fb6-4ad5-832b-ab2618c06ba0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=39e02c8648054bf7b77e58c3e22a7e1e, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:07.824579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8fd58-4fb6-4ad5-832b-ab2618c06ba0 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:07.841844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 19/40] 10.222.0.48 () {58 vars in 1361 bytes} [Thu May 12 18:45:07 2022] PUT /identity/v3/domains/default/users/39e02c8648054bf7b77e58c3e22a7e1e/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:07.842799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8fd58-4fb6-4ad5-832b-ab2618c06ba0 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:07.952549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 22/41] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 12 18:45:07 2022] POST /identity/v3/roles => generated 223 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:07.959247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8fd58-4fb6-4ad5-832b-ab2618c06ba0 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:08.007039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08200bb4-9dc3-4694-b1c1-dcae815a935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:08.008113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08200bb4-9dc3-4694-b1c1-dcae815a935f None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:08.008604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08200bb4-9dc3-4694-b1c1-dcae815a935f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:08.009119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08200bb4-9dc3-4694-b1c1-dcae815a935f None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:08.010125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08200bb4-9dc3-4694-b1c1-dcae815a935f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:08.012596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08200bb4-9dc3-4694-b1c1-dcae815a935f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:08.050743 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 20/42] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:45:07 2022] POST /identity/v3/projects => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:08.256693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53d080-9692-48df-beef-30733c412c48 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:08.257188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53d080-9692-48df-beef-30733c412c48 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:08.257188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53d080-9692-48df-beef-30733c412c48 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:08.258829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 23/43] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:08.264903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720505d4-232b-4217-8ded-8c07cb8f5a2d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:08.265397 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720505d4-232b-4217-8ded-8c07cb8f5a2d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:08.265474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720505d4-232b-4217-8ded-8c07cb8f5a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:08.283204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-720505d4-232b-4217-8ded-8c07cb8f5a2d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:08.284449 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-720505d4-232b-4217-8ded-8c07cb8f5a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:08.351717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 21/44] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:08.375788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53d080-9692-48df-beef-30733c412c48 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:08.475304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53d080-9692-48df-beef-30733c412c48 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:08.509321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe991a7-0fe2-46cf-91e9-95c81404f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:08.510076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe991a7-0fe2-46cf-91e9-95c81404f56c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:08.510365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe991a7-0fe2-46cf-91e9-95c81404f56c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:08.510644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe991a7-0fe2-46cf-91e9-95c81404f56c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:08.512475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe991a7-0fe2-46cf-91e9-95c81404f56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:08.514096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe991a7-0fe2-46cf-91e9-95c81404f56c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:08.515751 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 24/45] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:08.521314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720505d4-232b-4217-8ded-8c07cb8f5a2d None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:08.624036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720505d4-232b-4217-8ded-8c07cb8f5a2d None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:08.657331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e017f-684b-4ffb-b425-86f2a23bb56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:08.658026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e017f-684b-4ffb-b425-86f2a23bb56f None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:08.658313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e017f-684b-4ffb-b425-86f2a23bb56f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:08.658586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e017f-684b-4ffb-b425-86f2a23bb56f None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:08.659300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e017f-684b-4ffb-b425-86f2a23bb56f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:08.660748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e017f-684b-4ffb-b425-86f2a23bb56f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:08.694718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:45:08 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:10.305429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635c9d-bc41-4c15-a559-24c3c7a27b04 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:10.305996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635c9d-bc41-4c15-a559-24c3c7a27b04 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:10.306083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635c9d-bc41-4c15-a559-24c3c7a27b04 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:10.307395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:10.312684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9bacf-f06a-4580-a352-dcc2fb823ff4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:10.313078 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9bacf-f06a-4580-a352-dcc2fb823ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:10.313244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9bacf-f06a-4580-a352-dcc2fb823ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:10.330259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e8c9bacf-f06a-4580-a352-dcc2fb823ff4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:10.331446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e8c9bacf-f06a-4580-a352-dcc2fb823ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:10.395550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:10.419025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80635c9d-bc41-4c15-a559-24c3c7a27b04 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:10.517144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80635c9d-bc41-4c15-a559-24c3c7a27b04 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:10.549142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4497-f700-4d94-afad-eb06d662e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:10.549970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4497-f700-4d94-afad-eb06d662e2ae None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:10.550257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4497-f700-4d94-afad-eb06d662e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:10.550533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4497-f700-4d94-afad-eb06d662e2ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:10.561898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d4497-f700-4d94-afad-eb06d662e2ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-365d4497-f700-4d94-afad-eb06d662e2ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:10.572345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:10.573293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:10.574666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 26/49] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:10.581271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9bacf-f06a-4580-a352-dcc2fb823ff4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:10.675592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9bacf-f06a-4580-a352-dcc2fb823ff4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:10.709293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc45e41-728d-4928-93f0-9547cfd2e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:10.710008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45e41-728d-4928-93f0-9547cfd2e331 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:10.710312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45e41-728d-4928-93f0-9547cfd2e331 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:10.710590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45e41-728d-4928-93f0-9547cfd2e331 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:10.711336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc45e41-728d-4928-93f0-9547cfd2e331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:10.711644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc45e41-728d-4928-93f0-9547cfd2e331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:10.713043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc45e41-728d-4928-93f0-9547cfd2e331 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:10.720973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 24/50] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:10.726395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4497-f700-4d94-afad-eb06d662e2ae None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:10.826525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4497-f700-4d94-afad-eb06d662e2ae None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:10.858646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ef062-8e14-4534-911f-f329e0a038c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:10.859511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ef062-8e14-4534-911f-f329e0a038c2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:10.859795 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ef062-8e14-4534-911f-f329e0a038c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:10.860072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ef062-8e14-4534-911f-f329e0a038c2 None admin] PATH_INFO: `/v3/users/39e02c8648054bf7b77e58c3e22a7e1e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:10.861349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ef062-8e14-4534-911f-f329e0a038c2 None admin] RBAC: Authorizing `identity:get_user(user_id=39e02c8648054bf7b77e58c3e22a7e1e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:10.862832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ef062-8e14-4534-911f-f329e0a038c2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:10.864467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 27/51] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:10 2022] GET /identity/v3/users/39e02c8648054bf7b77e58c3e22a7e1e => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:10.869820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc45e41-728d-4928-93f0-9547cfd2e331 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:10.965354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f343be-8bc4-4c90-aabc-be99dd57a3fd None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:10.965676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f343be-8bc4-4c90-aabc-be99dd57a3fd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:10.965960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f343be-8bc4-4c90-aabc-be99dd57a3fd None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:10.966051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc45e41-728d-4928-93f0-9547cfd2e331 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:10.967443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 28/52] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:45:10.972366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f545bc-3fe6-4d35-93eb-ca2480be5a9a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:10.972656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f545bc-3fe6-4d35-93eb-ca2480be5a9a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:10.972936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f545bc-3fe6-4d35-93eb-ca2480be5a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:10.990124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-95f545bc-3fe6-4d35-93eb-ca2480be5a9a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:10.991648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-95f545bc-3fe6-4d35-93eb-ca2480be5a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:10.998926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c994c-5f55-4eff-98fe-31f3344996ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:10.999711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c994c-5f55-4eff-98fe-31f3344996ed None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:10.999996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c994c-5f55-4eff-98fe-31f3344996ed None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:11.000277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c994c-5f55-4eff-98fe-31f3344996ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:11.001431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c994c-5f55-4eff-98fe-31f3344996ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:11.002910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c994c-5f55-4eff-98fe-31f3344996ed None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:11.004671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 25/53] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:11.010326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c994c-5f55-4eff-98fe-31f3344996ed None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:11.056100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 29/54] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:11.079172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f545bc-3fe6-4d35-93eb-ca2480be5a9a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:11.106287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c994c-5f55-4eff-98fe-31f3344996ed None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:11.139489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726f07a-0bd9-4476-acad-fddbbd3dd623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:11.140152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726f07a-0bd9-4476-acad-fddbbd3dd623 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:11.140437 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726f07a-0bd9-4476-acad-fddbbd3dd623 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:11.140716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726f07a-0bd9-4476-acad-fddbbd3dd623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:11.141550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726f07a-0bd9-4476-acad-fddbbd3dd623 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.domain.id=default, user.id=39e02c8648054bf7b77e58c3e22a7e1e) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:11.141883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726f07a-0bd9-4476-acad-fddbbd3dd623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:11.143315 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726f07a-0bd9-4476-acad-fddbbd3dd623 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:11.149796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1322 bytes} [Thu May 12 18:45:11 2022] GET /identity/v3/role_assignments?user.id=39e02c8648054bf7b77e58c3e22a7e1e&scope.domain.id=default&role.id=d03e020b3fb34446bbf5893b28904483 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:11.175731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f545bc-3fe6-4d35-93eb-ca2480be5a9a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:11.210554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c9dfa-dee9-42e2-a4ac-6b71a6b29c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:11.211375 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c9dfa-dee9-42e2-a4ac-6b71a6b29c4c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:11.211663 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c9dfa-dee9-42e2-a4ac-6b71a6b29c4c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:11.211941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c9dfa-dee9-42e2-a4ac-6b71a6b29c4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:11.213211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c9dfa-dee9-42e2-a4ac-6b71a6b29c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:11.215281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c9dfa-dee9-42e2-a4ac-6b71a6b29c4c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:11.217083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:11.222776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726f07a-0bd9-4476-acad-fddbbd3dd623 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:11.324783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726f07a-0bd9-4476-acad-fddbbd3dd623 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:11.359148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967efd2-f54f-4b48-82d4-5608d66e49fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:11.359815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967efd2-f54f-4b48-82d4-5608d66e49fe None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:11.360099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967efd2-f54f-4b48-82d4-5608d66e49fe None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:11.360377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967efd2-f54f-4b48-82d4-5608d66e49fe None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:11.361080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967efd2-f54f-4b48-82d4-5608d66e49fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:11.362542 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967efd2-f54f-4b48-82d4-5608d66e49fe None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:11.389024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 27/57] 10.222.0.48 () {60 vars in 1140 bytes} [Thu May 12 18:45:11 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:13.608460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b80bda-7a96-47a0-befd-ffbf59e545ea None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:13.609011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b80bda-7a96-47a0-befd-ffbf59e545ea None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:13.609011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b80bda-7a96-47a0-befd-ffbf59e545ea None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:13.610405 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:13.615601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4fbea-8915-4ec6-8a4b-98097b99cc12 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:13.616012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4fbea-8915-4ec6-8a4b-98097b99cc12 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:13.616149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4fbea-8915-4ec6-8a4b-98097b99cc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:13.632906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9bb4fbea-8915-4ec6-8a4b-98097b99cc12 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:13.634114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9bb4fbea-8915-4ec6-8a4b-98097b99cc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:13.695664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:13.719666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b80bda-7a96-47a0-befd-ffbf59e545ea None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:13.813910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b80bda-7a96-47a0-befd-ffbf59e545ea None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:13.844679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75176e0f-4439-4f35-ba9d-804581c1d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:13.845465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75176e0f-4439-4f35-ba9d-804581c1d0ec None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:13.845775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75176e0f-4439-4f35-ba9d-804581c1d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:13.846051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75176e0f-4439-4f35-ba9d-804581c1d0ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:13.847214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75176e0f-4439-4f35-ba9d-804581c1d0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:13.848668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75176e0f-4439-4f35-ba9d-804581c1d0ec None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:13.850292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:13.856266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4fbea-8915-4ec6-8a4b-98097b99cc12 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:13.949402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4fbea-8915-4ec6-8a4b-98097b99cc12 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:13.980956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac41233-1883-4cce-aaf1-eb7d80da11ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:13.981637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac41233-1883-4cce-aaf1-eb7d80da11ac None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:13.981925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac41233-1883-4cce-aaf1-eb7d80da11ac None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:13.982201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac41233-1883-4cce-aaf1-eb7d80da11ac None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:13.982896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac41233-1883-4cce-aaf1-eb7d80da11ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:13.984383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac41233-1883-4cce-aaf1-eb7d80da11ac None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:14.008103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:45:13 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:17.441716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9c712-8b0a-4594-867a-98191facfcb7 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.442245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9c712-8b0a-4594-867a-98191facfcb7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.442321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9c712-8b0a-4594-867a-98191facfcb7 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.443725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:17.449325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e3b4c-a48a-4d44-a404-ee24a9c81a36 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.450196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e3b4c-a48a-4d44-a404-ee24a9c81a36 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.450699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e3b4c-a48a-4d44-a404-ee24a9c81a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.471567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296ba4-b00b-4bf5-a94f-f33f65755420 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.472197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296ba4-b00b-4bf5-a94f-f33f65755420 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.472677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296ba4-b00b-4bf5-a94f-f33f65755420 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.474686 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 34/63] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:17.479880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-8a0e3b4c-a48a-4d44-a404-ee24a9c81a36 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:17.481754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8a0e3b4c-a48a-4d44-a404-ee24a9c81a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:17.494504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8afcc-db0d-475f-9f4f-4d466df14639 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.495148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8afcc-db0d-475f-9f4f-4d466df14639 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.495680 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8afcc-db0d-475f-9f4f-4d466df14639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.526875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c8f8afcc-db0d-475f-9f4f-4d466df14639 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:17.529698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c8f8afcc-db0d-475f-9f4f-4d466df14639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:17.581423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 30/64] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:17.605313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e3b4c-a48a-4d44-a404-ee24a9c81a36 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:17.660928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 35/65] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:17.681338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeae2b-04f1-406c-9c3d-ade1abbb71dd None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.681978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeae2b-04f1-406c-9c3d-ade1abbb71dd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.682453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeae2b-04f1-406c-9c3d-ade1abbb71dd None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.684099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 36/66] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:45:17.686067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeae2b-04f1-406c-9c3d-ade1abbb71dd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:17.744374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e3b4c-a48a-4d44-a404-ee24a9c81a36 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:17.780333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaa1b8-7588-4e3a-ba50-269ae4503d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:17.781358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaa1b8-7588-4e3a-ba50-269ae4503d7e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.781820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaa1b8-7588-4e3a-ba50-269ae4503d7e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.782256 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaa1b8-7588-4e3a-ba50-269ae4503d7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.792774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaa1b8-7588-4e3a-ba50-269ae4503d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-2aeaa1b8-7588-4e3a-ba50-269ae4503d7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:17.800889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:17.801969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:17.802745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:17.805850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 31/67] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:17.807367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f64f-09b7-417a-98cf-94fd5a59ff87 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.807850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f64f-09b7-417a-98cf-94fd5a59ff87 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.808346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f64f-09b7-417a-98cf-94fd5a59ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.810133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeae2b-04f1-406c-9c3d-ade1abbb71dd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:17.825732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b584f64f-09b7-417a-98cf-94fd5a59ff87 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:17.826904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b584f64f-09b7-417a-98cf-94fd5a59ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:17.844014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ffe7e-c4b1-494b-ba87-8454ba691911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:17.844806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ffe7e-c4b1-494b-ba87-8454ba691911 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.845093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ffe7e-c4b1-494b-ba87-8454ba691911 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.845370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ffe7e-c4b1-494b-ba87-8454ba691911 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.855263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ffe7e-c4b1-494b-ba87-8454ba691911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-845ffe7e-c4b1-494b-ba87-8454ba691911 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:17.862839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:17.863703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 37/68] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:17.869691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24ac5-f7b9-444c-adb1-b21af0707cb4 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.870389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24ac5-f7b9-444c-adb1-b21af0707cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.870389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24ac5-f7b9-444c-adb1-b21af0707cb4 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.870389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 38/69] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:17.870389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24ac5-f7b9-444c-adb1-b21af0707cb4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:17.900911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 32/70] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:17.902636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08a2f5-d3f0-4dc0-8936-181bbcc9db4b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:17.902934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08a2f5-d3f0-4dc0-8936-181bbcc9db4b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:17.903244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08a2f5-d3f0-4dc0-8936-181bbcc9db4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:17.920914 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4a08a2f5-d3f0-4dc0-8936-181bbcc9db4b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:17.922775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4a08a2f5-d3f0-4dc0-8936-181bbcc9db4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:17.992254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 33/71] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:17.993291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08a2f5-d3f0-4dc0-8936-181bbcc9db4b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.003292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24ac5-f7b9-444c-adb1-b21af0707cb4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.039429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8591a7-dfae-4764-bb2c-1fae293af472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.040102 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8591a7-dfae-4764-bb2c-1fae293af472 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.040731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8591a7-dfae-4764-bb2c-1fae293af472 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.040731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8591a7-dfae-4764-bb2c-1fae293af472 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.041402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8591a7-dfae-4764-bb2c-1fae293af472 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:18.041740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8591a7-dfae-4764-bb2c-1fae293af472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:18.043113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8591a7-dfae-4764-bb2c-1fae293af472 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:18.059873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 39/72] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:18.059873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8591a7-dfae-4764-bb2c-1fae293af472 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.102374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08a2f5-d3f0-4dc0-8936-181bbcc9db4b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.134675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d7f13-f448-4f4d-87bd-42d196d585cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.135347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d7f13-f448-4f4d-87bd-42d196d585cc None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.135637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d7f13-f448-4f4d-87bd-42d196d585cc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.135919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d7f13-f448-4f4d-87bd-42d196d585cc None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.137368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d7f13-f448-4f4d-87bd-42d196d585cc None admin] RBAC: Adding query filter params (name=member) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:18.137714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d7f13-f448-4f4d-87bd-42d196d585cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:18.139110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d7f13-f448-4f4d-87bd-42d196d585cc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:18.147299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 34/73] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:18.148083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d7f13-f448-4f4d-87bd-42d196d585cc None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.150263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8591a7-dfae-4764-bb2c-1fae293af472 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.184278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a5636-9ddb-4a55-ad72-7983d9c602c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.185089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a5636-9ddb-4a55-ad72-7983d9c602c5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.185378 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a5636-9ddb-4a55-ad72-7983d9c602c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.185687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a5636-9ddb-4a55-ad72-7983d9c602c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.195340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a5636-9ddb-4a55-ad72-7983d9c602c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c23a5636-9ddb-4a55-ad72-7983d9c602c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:18.203926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:18.204909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:18.205744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 40/74] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:45:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:18.206388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a5636-9ddb-4a55-ad72-7983d9c602c5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.245269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d7f13-f448-4f4d-87bd-42d196d585cc None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.277981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986d077-d77c-4951-b7d8-d1dcf35693d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.278706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986d077-d77c-4951-b7d8-d1dcf35693d0 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.278989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986d077-d77c-4951-b7d8-d1dcf35693d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.279267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986d077-d77c-4951-b7d8-d1dcf35693d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.280446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986d077-d77c-4951-b7d8-d1dcf35693d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:18.281940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986d077-d77c-4951-b7d8-d1dcf35693d0 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:18.283536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 35/75] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:18.287941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e517f07-9b4b-4aae-856c-c6adabe5f13c None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.287941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e517f07-9b4b-4aae-856c-c6adabe5f13c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.287941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e517f07-9b4b-4aae-856c-c6adabe5f13c None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.287941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 36/76] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:18.287941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e517f07-9b4b-4aae-856c-c6adabe5f13c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.303971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a5636-9ddb-4a55-ad72-7983d9c602c5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.337629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac029de-c070-45ea-a41e-ce256f1f18ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.338501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac029de-c070-45ea-a41e-ce256f1f18ff None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.338790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac029de-c070-45ea-a41e-ce256f1f18ff None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.339073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac029de-c070-45ea-a41e-ce256f1f18ff None admin] PATH_INFO: `/v3/users/39e02c8648054bf7b77e58c3e22a7e1e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.340320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac029de-c070-45ea-a41e-ce256f1f18ff None admin] RBAC: Authorizing `identity:get_user(user_id=39e02c8648054bf7b77e58c3e22a7e1e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:18.341815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac029de-c070-45ea-a41e-ce256f1f18ff None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:18.343456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 41/77] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:18 2022] GET /identity/v3/users/39e02c8648054bf7b77e58c3e22a7e1e => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:18.344224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac029de-c070-45ea-a41e-ce256f1f18ff None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.385440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e517f07-9b4b-4aae-856c-c6adabe5f13c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.416473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4574971-2d6f-4e94-a09a-b4b05d12dcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.417334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4574971-2d6f-4e94-a09a-b4b05d12dcb2 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.418131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4574971-2d6f-4e94-a09a-b4b05d12dcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.418404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4574971-2d6f-4e94-a09a-b4b05d12dcb2 None admin] PATH_INFO: `/v3/users/dcc5667f58514c749c19bbe4de82923c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.431057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4574971-2d6f-4e94-a09a-b4b05d12dcb2 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5667f58514c749c19bbe4de82923c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:18.432516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4574971-2d6f-4e94-a09a-b4b05d12dcb2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:18.434779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 37/78] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:18 2022] GET /identity/v3/users/dcc5667f58514c749c19bbe4de82923c => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:18.435517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4574971-2d6f-4e94-a09a-b4b05d12dcb2 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.441400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac029de-c070-45ea-a41e-ce256f1f18ff None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.473017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdf150-b010-45f3-a23f-ac9c73c9a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.473709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdf150-b010-45f3-a23f-ac9c73c9a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.473992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdf150-b010-45f3-a23f-ac9c73c9a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.474267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdf150-b010-45f3-a23f-ac9c73c9a6b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.475014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdf150-b010-45f3-a23f-ac9c73c9a6b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:18.475326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdf150-b010-45f3-a23f-ac9c73c9a6b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:18.476696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdf150-b010-45f3-a23f-ac9c73c9a6b3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:18.484876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 42/79] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:45:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:18.486046 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa27c0-ab9b-4a5e-a3b1-707f2f5dbfa6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.486343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa27c0-ab9b-4a5e-a3b1-707f2f5dbfa6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.486623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa27c0-ab9b-4a5e-a3b1-707f2f5dbfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.502447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0daa27c0-ab9b-4a5e-a3b1-707f2f5dbfa6 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:18.503641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0daa27c0-ab9b-4a5e-a3b1-707f2f5dbfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:18.527173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4574971-2d6f-4e94-a09a-b4b05d12dcb2 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.559854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55850967-76bf-4697-9284-5d4833743a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.560446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55850967-76bf-4697-9284-5d4833743a36 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.560728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55850967-76bf-4697-9284-5d4833743a36 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.561000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55850967-76bf-4697-9284-5d4833743a36 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.561731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55850967-76bf-4697-9284-5d4833743a36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:18.563159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55850967-76bf-4697-9284-5d4833743a36 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:18.565979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 43/80] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:18.566808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa27c0-ab9b-4a5e-a3b1-707f2f5dbfa6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.582669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 38/81] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:45:18 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:18.583483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55850967-76bf-4697-9284-5d4833743a36 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.683299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa27c0-ab9b-4a5e-a3b1-707f2f5dbfa6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.687062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55850967-76bf-4697-9284-5d4833743a36 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:18.718834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62e257-270b-4f84-975e-fcc9d9151aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.719503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e257-270b-4f84-975e-fcc9d9151aff None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.719793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e257-270b-4f84-975e-fcc9d9151aff None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.720077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e257-270b-4f84-975e-fcc9d9151aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.722232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8209db-20e5-4b9f-a78c-948c310df3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:18.722911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8209db-20e5-4b9f-a78c-948c310df3fb None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:18.723180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8209db-20e5-4b9f-a78c-948c310df3fb None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:18.723458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8209db-20e5-4b9f-a78c-948c310df3fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:18.790117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62e257-270b-4f84-975e-fcc9d9151aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:18.791713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62e257-270b-4f84-975e-fcc9d9151aff None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:18.795092 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8209db-20e5-4b9f-a78c-948c310df3fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:18.796656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8209db-20e5-4b9f-a78c-948c310df3fb None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:18.897024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 44/82] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:18.897849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62e257-270b-4f84-975e-fcc9d9151aff None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.912847 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 39/83] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:18.913648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8209db-20e5-4b9f-a78c-948c310df3fb None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:18.999629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62e257-270b-4f84-975e-fcc9d9151aff None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.014007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8209db-20e5-4b9f-a78c-948c310df3fb None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.036812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a728-a702-473c-8620-59b3572d8b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.037732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a728-a702-473c-8620-59b3572d8b1f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.038023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a728-a702-473c-8620-59b3572d8b1f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.038307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a728-a702-473c-8620-59b3572d8b1f None admin] PATH_INFO: `/v3/users/dcc5667f58514c749c19bbe4de82923c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.039534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19a728-a702-473c-8620-59b3572d8b1f None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5667f58514c749c19bbe4de82923c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:19.041003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19a728-a702-473c-8620-59b3572d8b1f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:19.042716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 45/84] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:18 2022] GET /identity/v3/users/dcc5667f58514c749c19bbe4de82923c => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:19.043480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a728-a702-473c-8620-59b3572d8b1f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.049322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058760-8c0a-458f-aaa7-0a37b49bfea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.050164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058760-8c0a-458f-aaa7-0a37b49bfea7 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.050646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058760-8c0a-458f-aaa7-0a37b49bfea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.050929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058760-8c0a-458f-aaa7-0a37b49bfea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.064482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f058760-8c0a-458f-aaa7-0a37b49bfea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-8f058760-8c0a-458f-aaa7-0a37b49bfea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:19.075579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:19.076410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:19.077164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:19.078226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 40/85] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:19.081567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058760-8c0a-458f-aaa7-0a37b49bfea7 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.151831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a728-a702-473c-8620-59b3572d8b1f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.187517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058760-8c0a-458f-aaa7-0a37b49bfea7 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.189008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08271d-1671-47bf-b5e7-3c1ab8093834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.190730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08271d-1671-47bf-b5e7-3c1ab8093834 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.190730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08271d-1671-47bf-b5e7-3c1ab8093834 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.190730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08271d-1671-47bf-b5e7-3c1ab8093834 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.191786 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08271d-1671-47bf-b5e7-3c1ab8093834 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:19.193235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08271d-1671-47bf-b5e7-3c1ab8093834 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:19.195157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 46/86] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:19.196217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08271d-1671-47bf-b5e7-3c1ab8093834 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.224162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dff9eb-9e99-4b2d-b993-6c4fa993103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.225254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dff9eb-9e99-4b2d-b993-6c4fa993103a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.225731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dff9eb-9e99-4b2d-b993-6c4fa993103a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.226154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dff9eb-9e99-4b2d-b993-6c4fa993103a None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.227553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dff9eb-9e99-4b2d-b993-6c4fa993103a None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:19.229160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dff9eb-9e99-4b2d-b993-6c4fa993103a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:19.231402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 41/87] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:19.232389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dff9eb-9e99-4b2d-b993-6c4fa993103a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.300961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08271d-1671-47bf-b5e7-3c1ab8093834 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.333061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dff9eb-9e99-4b2d-b993-6c4fa993103a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.336104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4310b-53c0-4b8f-af34-a4e41dc53b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.336431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4310b-53c0-4b8f-af34-a4e41dc53b09 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.336725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4310b-53c0-4b8f-af34-a4e41dc53b09 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.337008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4310b-53c0-4b8f-af34-a4e41dc53b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.372946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82abb-ee88-4875-a9a3-f509d4c90210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.373914 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82abb-ee88-4875-a9a3-f509d4c90210 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.374349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82abb-ee88-4875-a9a3-f509d4c90210 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.374772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82abb-ee88-4875-a9a3-f509d4c90210 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.375671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b82abb-ee88-4875-a9a3-f509d4c90210 None admin] RBAC: Adding query filter params (name=member) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:19.376153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b82abb-ee88-4875-a9a3-f509d4c90210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:19.378731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b82abb-ee88-4875-a9a3-f509d4c90210 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:19.391339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 42/88] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:19.392822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82abb-ee88-4875-a9a3-f509d4c90210 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.412842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4310b-53c0-4b8f-af34-a4e41dc53b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:19.414842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4310b-53c0-4b8f-af34-a4e41dc53b09 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:19.496283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82abb-ee88-4875-a9a3-f509d4c90210 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.527488 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 47/89] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:19.528950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4310b-53c0-4b8f-af34-a4e41dc53b09 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.531745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9b9b5-43d6-461b-a311-cccfeeb8d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.532504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9b9b5-43d6-461b-a311-cccfeeb8d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.533454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9b9b5-43d6-461b-a311-cccfeeb8d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.533454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9b9b5-43d6-461b-a311-cccfeeb8d3c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.534275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9b9b5-43d6-461b-a311-cccfeeb8d3c1 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=cb46cdbaf65d4668a7a32126ba096340, user.id=39e02c8648054bf7b77e58c3e22a7e1e) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:19.534658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9b9b5-43d6-461b-a311-cccfeeb8d3c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:19.536184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9b9b5-43d6-461b-a311-cccfeeb8d3c1 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:19.542037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 43/90] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/role_assignments?user.id=39e02c8648054bf7b77e58c3e22a7e1e&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=d03e020b3fb34446bbf5893b28904483 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:19.543044 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9b9b5-43d6-461b-a311-cccfeeb8d3c1 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.636810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4310b-53c0-4b8f-af34-a4e41dc53b09 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.650517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9b9b5-43d6-461b-a311-cccfeeb8d3c1 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.672989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518168ac-a2ff-45b3-ac58-1e0ecfc70c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.673924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518168ac-a2ff-45b3-ac58-1e0ecfc70c00 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.674358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518168ac-a2ff-45b3-ac58-1e0ecfc70c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.674783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518168ac-a2ff-45b3-ac58-1e0ecfc70c00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.675770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518168ac-a2ff-45b3-ac58-1e0ecfc70c00 None admin] RBAC: Adding query filter params (role.id=4a765555b657413ea79721175a7191e3, scope.project.id=cb46cdbaf65d4668a7a32126ba096340, user.id=dcc5667f58514c749c19bbe4de82923c) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:19.676258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518168ac-a2ff-45b3-ac58-1e0ecfc70c00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:19.677878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518168ac-a2ff-45b3-ac58-1e0ecfc70c00 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:19.686349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b535d-9a80-4b9d-965f-113580ea833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.687239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b535d-9a80-4b9d-965f-113580ea833a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.687522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b535d-9a80-4b9d-965f-113580ea833a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.687797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b535d-9a80-4b9d-965f-113580ea833a None admin] PATH_INFO: `/v3/users/dcc5667f58514c749c19bbe4de82923c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.688052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 48/91] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/role_assignments?user.id=dcc5667f58514c749c19bbe4de82923c&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=4a765555b657413ea79721175a7191e3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:19.689023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518168ac-a2ff-45b3-ac58-1e0ecfc70c00 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.689458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b535d-9a80-4b9d-965f-113580ea833a None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5667f58514c749c19bbe4de82923c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:19.690985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b535d-9a80-4b9d-965f-113580ea833a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:19.692677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 44/92] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/users/dcc5667f58514c749c19bbe4de82923c => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:19.700299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b535d-9a80-4b9d-965f-113580ea833a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.798527 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518168ac-a2ff-45b3-ac58-1e0ecfc70c00 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.833950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b535d-9a80-4b9d-965f-113580ea833a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:19.837116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8a782-7f4e-4f1f-bf4c-aed43b8367e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.838302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a782-7f4e-4f1f-bf4c-aed43b8367e2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.838774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a782-7f4e-4f1f-bf4c-aed43b8367e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.839277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a782-7f4e-4f1f-bf4c-aed43b8367e2 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:19.840775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a782-7f4e-4f1f-bf4c-aed43b8367e2 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:19.842536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a782-7f4e-4f1f-bf4c-aed43b8367e2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:19.844721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 49/93] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:19.850817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8a782-7f4e-4f1f-bf4c-aed43b8367e2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:19.901861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e507b-7be8-45b4-b69c-41fcf3a931cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:19.905750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e507b-7be8-45b4-b69c-41fcf3a931cb None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:19.906008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e507b-7be8-45b4-b69c-41fcf3a931cb None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:19.906290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e507b-7be8-45b4-b69c-41fcf3a931cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:20.005550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e507b-7be8-45b4-b69c-41fcf3a931cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:20.005550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e507b-7be8-45b4-b69c-41fcf3a931cb None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:20.037878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8a782-7f4e-4f1f-bf4c-aed43b8367e2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:20.091142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b6f51-e17c-4fe7-a3d0-e68c53d92507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:20.092126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6f51-e17c-4fe7-a3d0-e68c53d92507 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:20.092607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6f51-e17c-4fe7-a3d0-e68c53d92507 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:20.093083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6f51-e17c-4fe7-a3d0-e68c53d92507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:20.094134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b6f51-e17c-4fe7-a3d0-e68c53d92507 None admin] RBAC: Adding query filter params (role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=cb46cdbaf65d4668a7a32126ba096340, user.id=dcc5667f58514c749c19bbe4de82923c) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:20.094634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b6f51-e17c-4fe7-a3d0-e68c53d92507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:20.096253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b6f51-e17c-4fe7-a3d0-e68c53d92507 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:20.104483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 45/94] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:20.108069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 50/95] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:19 2022] GET /identity/v3/role_assignments?user.id=dcc5667f58514c749c19bbe4de82923c&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:20.110111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e507b-7be8-45b4-b69c-41fcf3a931cb None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:20.220374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e507b-7be8-45b4-b69c-41fcf3a931cb None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:20.261195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febac30-8c9e-43ad-a6a3-20c49a9bc173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:20.262022 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febac30-8c9e-43ad-a6a3-20c49a9bc173 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:20.262311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febac30-8c9e-43ad-a6a3-20c49a9bc173 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:20.262593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febac30-8c9e-43ad-a6a3-20c49a9bc173 None admin] PATH_INFO: `/v3/projects/9898b4fa8385483581f379f9ce465677` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:20.263821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febac30-8c9e-43ad-a6a3-20c49a9bc173 None admin] RBAC: Authorizing `identity:get_project(project_id=9898b4fa8385483581f379f9ce465677)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:20.265316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febac30-8c9e-43ad-a6a3-20c49a9bc173 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:20.267445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 46/96] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:20 2022] GET /identity/v3/projects/9898b4fa8385483581f379f9ce465677 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:20.273241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b6f51-e17c-4fe7-a3d0-e68c53d92507 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:20.378323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b6f51-e17c-4fe7-a3d0-e68c53d92507 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:20.417033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13a9db-efd5-4522-8f97-eab86f57bca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:20.418311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13a9db-efd5-4522-8f97-eab86f57bca9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:20.418607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13a9db-efd5-4522-8f97-eab86f57bca9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:20.418889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13a9db-efd5-4522-8f97-eab86f57bca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:20.419757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13a9db-efd5-4522-8f97-eab86f57bca9 None admin] RBAC: Adding query filter params (role.id=4a765555b657413ea79721175a7191e3, scope.project.id=9898b4fa8385483581f379f9ce465677, user.id=dcc5667f58514c749c19bbe4de82923c) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:20.420075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13a9db-efd5-4522-8f97-eab86f57bca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:20.421614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13a9db-efd5-4522-8f97-eab86f57bca9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:20.428035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 51/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:20 2022] GET /identity/v3/role_assignments?user.id=dcc5667f58514c749c19bbe4de82923c&scope.project.id=9898b4fa8385483581f379f9ce465677&role.id=4a765555b657413ea79721175a7191e3 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:21.645979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c38f-472a-4f8d-95df-3100ce911c5e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:21.646504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c38f-472a-4f8d-95df-3100ce911c5e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:21.646606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c38f-472a-4f8d-95df-3100ce911c5e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:21.648134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 47/98] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:21.654253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f52ee-1029-447a-808b-9239c142b483 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:21.654654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f52ee-1029-447a-808b-9239c142b483 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:21.654836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f52ee-1029-447a-808b-9239c142b483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:21.674580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e26f52ee-1029-447a-808b-9239c142b483 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:21.675803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e26f52ee-1029-447a-808b-9239c142b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:21.689362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d0846-adc2-42a2-9448-11a254d8db0a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:21.689691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d0846-adc2-42a2-9448-11a254d8db0a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:21.690137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d0846-adc2-42a2-9448-11a254d8db0a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:21.692352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 48/99] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:21.698720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4814535-7300-44cb-aa4f-6df2a123d40e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:21.699521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4814535-7300-44cb-aa4f-6df2a123d40e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:21.699802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4814535-7300-44cb-aa4f-6df2a123d40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:21.730523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d4814535-7300-44cb-aa4f-6df2a123d40e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:21.731713 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d4814535-7300-44cb-aa4f-6df2a123d40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:21.775037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 52/100] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:21.835971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f52ee-1029-447a-808b-9239c142b483 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:21.848305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 49/101] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:21.883114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4814535-7300-44cb-aa4f-6df2a123d40e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:22.014047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f52ee-1029-447a-808b-9239c142b483 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:22.065832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662246a-dc95-489e-9b35-34ee2e44ccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:22.066646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662246a-dc95-489e-9b35-34ee2e44ccd9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:22.066933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662246a-dc95-489e-9b35-34ee2e44ccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:22.067209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662246a-dc95-489e-9b35-34ee2e44ccd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:22.069485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662246a-dc95-489e-9b35-34ee2e44ccd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:22.071367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662246a-dc95-489e-9b35-34ee2e44ccd9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:22.073158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 53/102] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:22.079536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662246a-dc95-489e-9b35-34ee2e44ccd9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:22.091395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4814535-7300-44cb-aa4f-6df2a123d40e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:22.163134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93feac7d-d514-45a1-a30a-ade9a67af844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:22.163987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93feac7d-d514-45a1-a30a-ade9a67af844 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:22.164316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93feac7d-d514-45a1-a30a-ade9a67af844 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:22.164593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93feac7d-d514-45a1-a30a-ade9a67af844 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:22.185181 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93feac7d-d514-45a1-a30a-ade9a67af844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-93feac7d-d514-45a1-a30a-ade9a67af844 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:22.192926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:22.193804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:22.194619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 50/103] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:22.207215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93feac7d-d514-45a1-a30a-ade9a67af844 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:22.272307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662246a-dc95-489e-9b35-34ee2e44ccd9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:22.346312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c80c0-2e58-4b30-ab28-40fd6ec0120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:22.346973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c80c0-2e58-4b30-ab28-40fd6ec0120a None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:22.347258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c80c0-2e58-4b30-ab28-40fd6ec0120a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:22.347534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c80c0-2e58-4b30-ab28-40fd6ec0120a None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:22.348261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c80c0-2e58-4b30-ab28-40fd6ec0120a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:22.349748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c80c0-2e58-4b30-ab28-40fd6ec0120a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:22.371652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93feac7d-d514-45a1-a30a-ade9a67af844 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:22.398634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 54/104] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:45:22 2022] POST /identity/v3/projects => generated 302 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:22.423993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75519d-67b8-465c-b30d-ea98386c5086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:22.424681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75519d-67b8-465c-b30d-ea98386c5086 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:22.424963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75519d-67b8-465c-b30d-ea98386c5086 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:22.425239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75519d-67b8-465c-b30d-ea98386c5086 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:22.426113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75519d-67b8-465c-b30d-ea98386c5086 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:22.426421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75519d-67b8-465c-b30d-ea98386c5086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:22.427837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75519d-67b8-465c-b30d-ea98386c5086 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:22.445281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 51/105] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:22.451737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c80c0-2e58-4b30-ab28-40fd6ec0120a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:22.590253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c80c0-2e58-4b30-ab28-40fd6ec0120a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:22.629115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916003e-61b4-4570-aa44-3053c42f1d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:22.630043 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916003e-61b4-4570-aa44-3053c42f1d89 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:22.630333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916003e-61b4-4570-aa44-3053c42f1d89 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:22.630613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916003e-61b4-4570-aa44-3053c42f1d89 None admin] PATH_INFO: `/v3/users/d91eb5338e8c49a5a59216db6b756f4f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:22.655190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916003e-61b4-4570-aa44-3053c42f1d89 None admin] RBAC: Authorizing `identity:get_user(user_id=d91eb5338e8c49a5a59216db6b756f4f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:22.656687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916003e-61b4-4570-aa44-3053c42f1d89 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:22.658704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 55/106] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:22 2022] GET /identity/v3/users/d91eb5338e8c49a5a59216db6b756f4f => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:22.663909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75519d-67b8-465c-b30d-ea98386c5086 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:22.797266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75519d-67b8-465c-b30d-ea98386c5086 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:22.837015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cdd2-a999-417a-8116-16a3182d870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:22.837706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cdd2-a999-417a-8116-16a3182d870f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:22.837991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cdd2-a999-417a-8116-16a3182d870f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:22.838267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cdd2-a999-417a-8116-16a3182d870f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:22.906360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408cdd2-a999-417a-8116-16a3182d870f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:22.907772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408cdd2-a999-417a-8116-16a3182d870f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:22.972718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2ce7-873b-41b3-b3a3-5431f5ae6843 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:22.973112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2ce7-873b-41b3-b3a3-5431f5ae6843 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:22.973284 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2ce7-873b-41b3-b3a3-5431f5ae6843 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:22.975113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 56/107] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:22.982400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04926a7-df23-40cc-9ce4-8aa8d3a201e6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:22.982696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04926a7-df23-40cc-9ce4-8aa8d3a201e6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:22.982947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04926a7-df23-40cc-9ce4-8aa8d3a201e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.014413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 52/108] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:23.016837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c04926a7-df23-40cc-9ce4-8aa8d3a201e6 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:23.018143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c04926a7-df23-40cc-9ce4-8aa8d3a201e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:23.019741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cdd2-a999-417a-8116-16a3182d870f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:23.110979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 57/109] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:23.136730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cdd2-a999-417a-8116-16a3182d870f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:23.146642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04926a7-df23-40cc-9ce4-8aa8d3a201e6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:23.179462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7cdc6-13cc-4283-9f66-bc016c33ee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:23.180330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7cdc6-13cc-4283-9f66-bc016c33ee64 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.180609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7cdc6-13cc-4283-9f66-bc016c33ee64 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.180890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7cdc6-13cc-4283-9f66-bc016c33ee64 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.184837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7cdc6-13cc-4283-9f66-bc016c33ee64 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:23.186333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7cdc6-13cc-4283-9f66-bc016c33ee64 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:23.188038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 53/110] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:23 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:23.193823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7cdc6-13cc-4283-9f66-bc016c33ee64 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:23.304158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7cdc6-13cc-4283-9f66-bc016c33ee64 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:23.305940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04926a7-df23-40cc-9ce4-8aa8d3a201e6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:23.338674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23513cd-374d-4166-b7d3-d07df6280bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:23.340157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed22bcd-a10c-4968-bb38-ddb0443b8f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:23.340420 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23513cd-374d-4166-b7d3-d07df6280bf6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.340838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23513cd-374d-4166-b7d3-d07df6280bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.341246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23513cd-374d-4166-b7d3-d07df6280bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.341349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22bcd-a10c-4968-bb38-ddb0443b8f87 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.341734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22bcd-a10c-4968-bb38-ddb0443b8f87 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.342110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22bcd-a10c-4968-bb38-ddb0443b8f87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.342735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23513cd-374d-4166-b7d3-d07df6280bf6 None admin] RBAC: Adding query filter params (role.id=d3c2851744d94b809dac16599fa42789, scope.project.id=cb46cdbaf65d4668a7a32126ba096340, user.id=d91eb5338e8c49a5a59216db6b756f4f) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:23.343278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23513cd-374d-4166-b7d3-d07df6280bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:23.345365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23513cd-374d-4166-b7d3-d07df6280bf6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:23.352494 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 54/111] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:23 2022] GET /identity/v3/role_assignments?user.id=d91eb5338e8c49a5a59216db6b756f4f&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=d3c2851744d94b809dac16599fa42789 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:23.353233 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed22bcd-a10c-4968-bb38-ddb0443b8f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:23.354367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a07a5a-59d2-40d9-922a-ff6076943bcf None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.354823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a07a5a-59d2-40d9-922a-ff6076943bcf None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.355773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a07a5a-59d2-40d9-922a-ff6076943bcf None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.361450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 55/112] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-fed22bcd-a10c-4968-bb38-ddb0443b8f87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:23.362498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:23.363525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:23.364289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:23.365919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b9b8-71b1-491f-92d4-03fcf8c6d88a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.366356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 58/113] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:23.366793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b9b8-71b1-491f-92d4-03fcf8c6d88a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.367205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b9b8-71b1-491f-92d4-03fcf8c6d88a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.368848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 56/114] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:23.371285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229a299-c390-49c5-a3bf-e2dafaa8be87 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.372246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809b9b8-71b1-491f-92d4-03fcf8c6d88a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:23.373512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229a299-c390-49c5-a3bf-e2dafaa8be87 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.375359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229a299-c390-49c5-a3bf-e2dafaa8be87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.405439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e229a299-c390-49c5-a3bf-e2dafaa8be87 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:23.406909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e229a299-c390-49c5-a3bf-e2dafaa8be87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:23.481410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 59/115] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:23.487138 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d58fe-542f-499a-b895-0b2a0bd73110 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.487696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d58fe-542f-499a-b895-0b2a0bd73110 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.488119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d58fe-542f-499a-b895-0b2a0bd73110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.517973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c19d58fe-542f-499a-b895-0b2a0bd73110 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:23.519416 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c19d58fe-542f-499a-b895-0b2a0bd73110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:23.602186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809b9b8-71b1-491f-92d4-03fcf8c6d88a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:23.637356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 60/116] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:23.638499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d58fe-542f-499a-b895-0b2a0bd73110 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:23.667760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d0bf1-d996-4c34-8988-7068fef702b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:23.668479 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d0bf1-d996-4c34-8988-7068fef702b0 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.668716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d0bf1-d996-4c34-8988-7068fef702b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.668991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d0bf1-d996-4c34-8988-7068fef702b0 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.669766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d0bf1-d996-4c34-8988-7068fef702b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:23.670075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d0bf1-d996-4c34-8988-7068fef702b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:23.671483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d0bf1-d996-4c34-8988-7068fef702b0 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:23.692906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 57/117] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:23.693793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d0bf1-d996-4c34-8988-7068fef702b0 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:23.747965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d58fe-542f-499a-b895-0b2a0bd73110 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:23.790380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502032c-d6c4-4d9e-9927-a1d2dd6d57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:23.791543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502032c-d6c4-4d9e-9927-a1d2dd6d57d2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.792048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502032c-d6c4-4d9e-9927-a1d2dd6d57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.792608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502032c-d6c4-4d9e-9927-a1d2dd6d57d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.812996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502032c-d6c4-4d9e-9927-a1d2dd6d57d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-b502032c-d6c4-4d9e-9927-a1d2dd6d57d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:23.829092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:23.830033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:23.830787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:23.836045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 61/118] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:45:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:23.843030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502032c-d6c4-4d9e-9927-a1d2dd6d57d2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:23.909113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d0bf1-d996-4c34-8988-7068fef702b0 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:23.976118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593381-0a1a-4b21-9b93-a7225e391fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:23.977094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593381-0a1a-4b21-9b93-a7225e391fb6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:23.977384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593381-0a1a-4b21-9b93-a7225e391fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:23.977689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593381-0a1a-4b21-9b93-a7225e391fb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:23.999518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63593381-0a1a-4b21-9b93-a7225e391fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:24.003019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502032c-d6c4-4d9e-9927-a1d2dd6d57d2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-63593381-0a1a-4b21-9b93-a7225e391fb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:24.008060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:24.008905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:24.010108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 58/119] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:24.014388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593381-0a1a-4b21-9b93-a7225e391fb6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.041480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d397ff3-8ffb-4b4a-933d-27f7e2086ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.042851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d397ff3-8ffb-4b4a-933d-27f7e2086ed4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.043386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d397ff3-8ffb-4b4a-933d-27f7e2086ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.043853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d397ff3-8ffb-4b4a-933d-27f7e2086ed4 None admin] PATH_INFO: `/v3/users/dcc5667f58514c749c19bbe4de82923c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.045317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d397ff3-8ffb-4b4a-933d-27f7e2086ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5667f58514c749c19bbe4de82923c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:24.047339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d397ff3-8ffb-4b4a-933d-27f7e2086ed4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:24.049218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 62/120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:23 2022] GET /identity/v3/users/dcc5667f58514c749c19bbe4de82923c => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:24.050322 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d397ff3-8ffb-4b4a-933d-27f7e2086ed4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.147551 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593381-0a1a-4b21-9b93-a7225e391fb6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.158566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d397ff3-8ffb-4b4a-933d-27f7e2086ed4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.183950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17bba-c01c-4d16-bf3f-ccea4ac4edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.184620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17bba-c01c-4d16-bf3f-ccea4ac4edeb None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.184905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17bba-c01c-4d16-bf3f-ccea4ac4edeb None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.185182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17bba-c01c-4d16-bf3f-ccea4ac4edeb None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.185976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b17bba-c01c-4d16-bf3f-ccea4ac4edeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:24.186286 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b17bba-c01c-4d16-bf3f-ccea4ac4edeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:24.187681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b17bba-c01c-4d16-bf3f-ccea4ac4edeb None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:24.197578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 59/121] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:45:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:24.197578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17bba-c01c-4d16-bf3f-ccea4ac4edeb None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.206840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522924-f439-4384-93cb-389d1238f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.208059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522924-f439-4384-93cb-389d1238f471 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.208059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522924-f439-4384-93cb-389d1238f471 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.208536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522924-f439-4384-93cb-389d1238f471 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.209395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd522924-f439-4384-93cb-389d1238f471 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:24.209870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd522924-f439-4384-93cb-389d1238f471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:24.211448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd522924-f439-4384-93cb-389d1238f471 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:24.221489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 63/122] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:24.225555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dedbf6-0a42-42ea-a234-cc17b077da33 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.225555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dedbf6-0a42-42ea-a234-cc17b077da33 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.225555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dedbf6-0a42-42ea-a234-cc17b077da33 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.225555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 64/123] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:24.225555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dedbf6-0a42-42ea-a234-cc17b077da33 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.306967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17bba-c01c-4d16-bf3f-ccea4ac4edeb None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.337236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dedbf6-0a42-42ea-a234-cc17b077da33 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.341186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84718129-2e14-432f-bc2c-84ccb54ea50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.342253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718129-2e14-432f-bc2c-84ccb54ea50c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.342705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718129-2e14-432f-bc2c-84ccb54ea50c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.343119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718129-2e14-432f-bc2c-84ccb54ea50c None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.344468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84718129-2e14-432f-bc2c-84ccb54ea50c None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:24.346113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84718129-2e14-432f-bc2c-84ccb54ea50c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:24.352635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 60/124] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:24 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:24.353712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84718129-2e14-432f-bc2c-84ccb54ea50c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.373639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9587-399d-4760-9d94-c29033ed0bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.374608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9587-399d-4760-9d94-c29033ed0bcd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.374892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9587-399d-4760-9d94-c29033ed0bcd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.375169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9587-399d-4760-9d94-c29033ed0bcd None admin] PATH_INFO: `/v3/users/dcc5667f58514c749c19bbe4de82923c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.376412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a9587-399d-4760-9d94-c29033ed0bcd None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5667f58514c749c19bbe4de82923c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:24.378265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a9587-399d-4760-9d94-c29033ed0bcd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:24.379798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 65/125] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:24 2022] GET /identity/v3/users/dcc5667f58514c749c19bbe4de82923c => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:24.385103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265f24-de82-42f3-9a54-66e6a9dd02da None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.385398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265f24-de82-42f3-9a54-66e6a9dd02da None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.385907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265f24-de82-42f3-9a54-66e6a9dd02da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.402360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-87265f24-de82-42f3-9a54-66e6a9dd02da None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:24.403735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-87265f24-de82-42f3-9a54-66e6a9dd02da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:24.462835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84718129-2e14-432f-bc2c-84ccb54ea50c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.470147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 66/126] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:24.478309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87265f24-de82-42f3-9a54-66e6a9dd02da None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.497751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1a57-76f2-4610-b0b2-25154a8a7c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.499011 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1a57-76f2-4610-b0b2-25154a8a7c79 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.499501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1a57-76f2-4610-b0b2-25154a8a7c79 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.499978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1a57-76f2-4610-b0b2-25154a8a7c79 None admin] PATH_INFO: `/v3/users/39e02c8648054bf7b77e58c3e22a7e1e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.508299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1a57-76f2-4610-b0b2-25154a8a7c79 None admin] RBAC: Authorizing `identity:get_user(user_id=39e02c8648054bf7b77e58c3e22a7e1e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:24.510003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1a57-76f2-4610-b0b2-25154a8a7c79 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:24.511907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 61/127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:24 2022] GET /identity/v3/users/39e02c8648054bf7b77e58c3e22a7e1e => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:24.512869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1a57-76f2-4610-b0b2-25154a8a7c79 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.591070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87265f24-de82-42f3-9a54-66e6a9dd02da None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.612086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1a57-76f2-4610-b0b2-25154a8a7c79 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.625335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbb9d-2e7a-4aab-b344-e6f99620637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.626292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbb9d-2e7a-4aab-b344-e6f99620637c None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.626579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbb9d-2e7a-4aab-b344-e6f99620637c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.626858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbb9d-2e7a-4aab-b344-e6f99620637c None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340/users/dcc5667f58514c749c19bbe4de82923c/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.629082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbb9d-2e7a-4aab-b344-e6f99620637c None admin] RBAC: Authorizing `identity:create_grant(project_id=cb46cdbaf65d4668a7a32126ba096340, user_id=dcc5667f58514c749c19bbe4de82923c, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:24.630791 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbb9d-2e7a-4aab-b344-e6f99620637c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:24.647253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 67/128] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:45:24 2022] PUT /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340/users/dcc5667f58514c749c19bbe4de82923c/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:24.648245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbb9d-2e7a-4aab-b344-e6f99620637c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.659208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2f6d-aa6d-40a5-a8b0-23f001940c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.660556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2f6d-aa6d-40a5-a8b0-23f001940c33 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.661097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2f6d-aa6d-40a5-a8b0-23f001940c33 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.661609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2f6d-aa6d-40a5-a8b0-23f001940c33 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.670539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d2f6d-aa6d-40a5-a8b0-23f001940c33 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:24.673203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d2f6d-aa6d-40a5-a8b0-23f001940c33 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:24.675428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 62/129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:24 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:24.676629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2f6d-aa6d-40a5-a8b0-23f001940c33 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.768960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbb9d-2e7a-4aab-b344-e6f99620637c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.813826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ea465-2b8c-4bd0-b14e-7b978136b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.814656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ea465-2b8c-4bd0-b14e-7b978136b354 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.814956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ea465-2b8c-4bd0-b14e-7b978136b354 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.815503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ea465-2b8c-4bd0-b14e-7b978136b354 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.834878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ea465-2b8c-4bd0-b14e-7b978136b354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:24.840174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2f6d-aa6d-40a5-a8b0-23f001940c33 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-3b8ea465-2b8c-4bd0-b14e-7b978136b354 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:24.846966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:24.847883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:24.848712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 68/130] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:24.849410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ea465-2b8c-4bd0-b14e-7b978136b354 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.884411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edfb27-1a9c-491e-8a57-f449a4403508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:24.885668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edfb27-1a9c-491e-8a57-f449a4403508 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:24.886368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edfb27-1a9c-491e-8a57-f449a4403508 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:24.887818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edfb27-1a9c-491e-8a57-f449a4403508 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:24.893359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edfb27-1a9c-491e-8a57-f449a4403508 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:24.895604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edfb27-1a9c-491e-8a57-f449a4403508 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:24.898582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 63/131] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:24 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:24.899656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edfb27-1a9c-491e-8a57-f449a4403508 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:24.961801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ea465-2b8c-4bd0-b14e-7b978136b354 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:25.007347 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb946101-a285-426d-9692-3ff6dfdf2a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:25.008255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb946101-a285-426d-9692-3ff6dfdf2a22 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:25.008584 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb946101-a285-426d-9692-3ff6dfdf2a22 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:25.008867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb946101-a285-426d-9692-3ff6dfdf2a22 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340/users/dcc5667f58514c749c19bbe4de82923c/roles/ee5d57f7c4704b3d907933236c98c2c2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:25.015250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb946101-a285-426d-9692-3ff6dfdf2a22 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb46cdbaf65d4668a7a32126ba096340, user_id=dcc5667f58514c749c19bbe4de82923c, role_id=ee5d57f7c4704b3d907933236c98c2c2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:25.016835 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb946101-a285-426d-9692-3ff6dfdf2a22 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:25.036110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 69/132] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:45:24 2022] PUT /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340/users/dcc5667f58514c749c19bbe4de82923c/roles/ee5d57f7c4704b3d907933236c98c2c2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:25.041192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb946101-a285-426d-9692-3ff6dfdf2a22 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:25.093846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edfb27-1a9c-491e-8a57-f449a4403508 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:25.173196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee890c7-3613-4bab-acc2-f8b050dc45ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:25.175636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee890c7-3613-4bab-acc2-f8b050dc45ff None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:25.175986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee890c7-3613-4bab-acc2-f8b050dc45ff None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:25.176268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee890c7-3613-4bab-acc2-f8b050dc45ff None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:25.177092 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee890c7-3613-4bab-acc2-f8b050dc45ff None admin] RBAC: Adding query filter params (name=member) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:25.177405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee890c7-3613-4bab-acc2-f8b050dc45ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:25.179067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee890c7-3613-4bab-acc2-f8b050dc45ff None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:25.195972 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 64/133] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:25.204525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee890c7-3613-4bab-acc2-f8b050dc45ff None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:25.239654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb946101-a285-426d-9692-3ff6dfdf2a22 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:25.281172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a8ed1-6086-44cb-ab46-e1eed55f782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:25.282131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a8ed1-6086-44cb-ab46-e1eed55f782d None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:25.282415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a8ed1-6086-44cb-ab46-e1eed55f782d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:25.285558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a8ed1-6086-44cb-ab46-e1eed55f782d None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340/users/39e02c8648054bf7b77e58c3e22a7e1e/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:25.285558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a8ed1-6086-44cb-ab46-e1eed55f782d None admin] RBAC: Authorizing `identity:create_grant(project_id=cb46cdbaf65d4668a7a32126ba096340, user_id=39e02c8648054bf7b77e58c3e22a7e1e, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:25.286253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a8ed1-6086-44cb-ab46-e1eed55f782d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:25.315435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 70/134] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:45:25 2022] PUT /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340/users/39e02c8648054bf7b77e58c3e22a7e1e/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:25.374603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee890c7-3613-4bab-acc2-f8b050dc45ff None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:25.410858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abdf98-131a-4813-892c-cd42ec87531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:25.411651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abdf98-131a-4813-892c-cd42ec87531d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:25.411937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abdf98-131a-4813-892c-cd42ec87531d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:25.412216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abdf98-131a-4813-892c-cd42ec87531d None admin] PATH_INFO: `/v3/users/dcc5667f58514c749c19bbe4de82923c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:25.413578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abdf98-131a-4813-892c-cd42ec87531d None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5667f58514c749c19bbe4de82923c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:25.415087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abdf98-131a-4813-892c-cd42ec87531d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:25.416814 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 65/135] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:25 2022] GET /identity/v3/users/dcc5667f58514c749c19bbe4de82923c => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:25.423346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a8ed1-6086-44cb-ab46-e1eed55f782d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:25.451679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d7a72-f4d7-46e6-b473-b4a39b6b1c86 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:25.451987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d7a72-f4d7-46e6-b473-b4a39b6b1c86 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:25.452252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d7a72-f4d7-46e6-b473-b4a39b6b1c86 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:25.453844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 66/136] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:45:25.467372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294cd49-38ca-4938-9209-951585b99231 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:25.467763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294cd49-38ca-4938-9209-951585b99231 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:25.467955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294cd49-38ca-4938-9209-951585b99231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:25.493846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6294cd49-38ca-4938-9209-951585b99231 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:25.495053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6294cd49-38ca-4938-9209-951585b99231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:25.553920 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a8ed1-6086-44cb-ab46-e1eed55f782d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:25.618335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 67/137] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:25.639146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29187a5f-d721-47b3-ba49-c03beeb95bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:25.640028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29187a5f-d721-47b3-ba49-c03beeb95bca None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:25.640311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29187a5f-d721-47b3-ba49-c03beeb95bca None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:25.640586 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29187a5f-d721-47b3-ba49-c03beeb95bca None admin] PATH_INFO: `/v3/projects/9898b4fa8385483581f379f9ce465677` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:25.641823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29187a5f-d721-47b3-ba49-c03beeb95bca None admin] RBAC: Authorizing `identity:get_project(project_id=9898b4fa8385483581f379f9ce465677)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:25.643563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29187a5f-d721-47b3-ba49-c03beeb95bca None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:25.644352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294cd49-38ca-4938-9209-951585b99231 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:25.645266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 71/138] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:25 2022] GET /identity/v3/projects/9898b4fa8385483581f379f9ce465677 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:25.650741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29187a5f-d721-47b3-ba49-c03beeb95bca None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:25.784705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294cd49-38ca-4938-9209-951585b99231 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:25.835473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e775a6-e906-4f05-8de9-97be3a86e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:25.836321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e775a6-e906-4f05-8de9-97be3a86e365 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:25.836602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e775a6-e906-4f05-8de9-97be3a86e365 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:25.836869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e775a6-e906-4f05-8de9-97be3a86e365 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:25.842231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e775a6-e906-4f05-8de9-97be3a86e365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:25.843754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e775a6-e906-4f05-8de9-97be3a86e365 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:25.845805 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 68/139] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:25.853704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e775a6-e906-4f05-8de9-97be3a86e365 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:25.895726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29187a5f-d721-47b3-ba49-c03beeb95bca None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:25.986671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2c9ae-0887-4917-9745-52917157de7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:25.987580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2c9ae-0887-4917-9745-52917157de7f None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:25.987869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2c9ae-0887-4917-9745-52917157de7f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:25.988147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2c9ae-0887-4917-9745-52917157de7f None admin] PATH_INFO: `/v3/projects/9898b4fa8385483581f379f9ce465677/users/dcc5667f58514c749c19bbe4de82923c/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:25.992099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2c9ae-0887-4917-9745-52917157de7f None admin] RBAC: Authorizing `identity:create_grant(project_id=9898b4fa8385483581f379f9ce465677, user_id=dcc5667f58514c749c19bbe4de82923c, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:25.993590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2c9ae-0887-4917-9745-52917157de7f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:26.019571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 72/140] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:45:25 2022] PUT /identity/v3/projects/9898b4fa8385483581f379f9ce465677/users/dcc5667f58514c749c19bbe4de82923c/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:45:26.027828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e775a6-e906-4f05-8de9-97be3a86e365 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:26.077871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31f877-2f62-4792-80b6-a5fe11b8be73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:26.078470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31f877-2f62-4792-80b6-a5fe11b8be73 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:26.078756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31f877-2f62-4792-80b6-a5fe11b8be73 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:26.079034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31f877-2f62-4792-80b6-a5fe11b8be73 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:26.079753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31f877-2f62-4792-80b6-a5fe11b8be73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:26.081228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31f877-2f62-4792-80b6-a5fe11b8be73 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:26.114040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 69/141] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:45:25 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:45:26.250022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e04fd3-ed5c-4f69-86ea-08fa27f9c42d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:26.250362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e04fd3-ed5c-4f69-86ea-08fa27f9c42d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:26.250601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e04fd3-ed5c-4f69-86ea-08fa27f9c42d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:26.252025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 73/142] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:26.267372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9d6e8-7fb0-4d7a-becd-e026b8c5c99a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:26.267665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9d6e8-7fb0-4d7a-becd-e026b8c5c99a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:26.267944 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9d6e8-7fb0-4d7a-becd-e026b8c5c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:26.290287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-13c9d6e8-7fb0-4d7a-becd-e026b8c5c99a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:26.291490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-13c9d6e8-7fb0-4d7a-becd-e026b8c5c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:26.379826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 70/143] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:26.414770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e04fd3-ed5c-4f69-86ea-08fa27f9c42d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:26.532901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e04fd3-ed5c-4f69-86ea-08fa27f9c42d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:26.569001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed7e2-3343-41c7-96de-85411df726c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:26.570173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed7e2-3343-41c7-96de-85411df726c4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:26.570652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed7e2-3343-41c7-96de-85411df726c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:26.571112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed7e2-3343-41c7-96de-85411df726c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:26.586378 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed7e2-3343-41c7-96de-85411df726c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-62aed7e2-3343-41c7-96de-85411df726c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:26.595115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:26.595959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:26.596735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:26.598705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 74/144] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:26.606621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9d6e8-7fb0-4d7a-becd-e026b8c5c99a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:26.754861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9d6e8-7fb0-4d7a-becd-e026b8c5c99a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:26.800005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1993f-f97f-4d6a-8250-dfbe6f201be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:26.800785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1993f-f97f-4d6a-8250-dfbe6f201be9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:26.800963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1993f-f97f-4d6a-8250-dfbe6f201be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:26.801244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1993f-f97f-4d6a-8250-dfbe6f201be9 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:26.802030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1993f-f97f-4d6a-8250-dfbe6f201be9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:26.802340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1993f-f97f-4d6a-8250-dfbe6f201be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:26.803728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1993f-f97f-4d6a-8250-dfbe6f201be9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:26.812481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 71/145] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:26.820147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed7e2-3343-41c7-96de-85411df726c4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:26.986324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed7e2-3343-41c7-96de-85411df726c4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:27.031425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d95258-30bd-4eb4-8d60-af5ad9c03307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:27.032652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95258-30bd-4eb4-8d60-af5ad9c03307 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:27.033161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95258-30bd-4eb4-8d60-af5ad9c03307 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:27.033661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95258-30bd-4eb4-8d60-af5ad9c03307 None admin] PATH_INFO: `/v3/users/d91eb5338e8c49a5a59216db6b756f4f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:27.035136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d95258-30bd-4eb4-8d60-af5ad9c03307 None admin] RBAC: Authorizing `identity:get_user(user_id=d91eb5338e8c49a5a59216db6b756f4f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:27.036783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d95258-30bd-4eb4-8d60-af5ad9c03307 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:27.038631 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 75/146] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:26 2022] GET /identity/v3/users/d91eb5338e8c49a5a59216db6b756f4f => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:27.045991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1993f-f97f-4d6a-8250-dfbe6f201be9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:27.161670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1993f-f97f-4d6a-8250-dfbe6f201be9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:27.200815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85023293-5ce9-44d6-a018-2c361a468e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:27.201711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85023293-5ce9-44d6-a018-2c361a468e1a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:27.202001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85023293-5ce9-44d6-a018-2c361a468e1a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:27.202281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85023293-5ce9-44d6-a018-2c361a468e1a None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:27.203490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85023293-5ce9-44d6-a018-2c361a468e1a None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:27.204956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85023293-5ce9-44d6-a018-2c361a468e1a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:27.206885 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 72/147] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:27 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:27.212358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d95258-30bd-4eb4-8d60-af5ad9c03307 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:27.359585 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d95258-30bd-4eb4-8d60-af5ad9c03307 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:27.412647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f0515-e71f-4dd1-b5e7-fbbeb7d18fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:27.413587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f0515-e71f-4dd1-b5e7-fbbeb7d18fec None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:27.413884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f0515-e71f-4dd1-b5e7-fbbeb7d18fec None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:27.414166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f0515-e71f-4dd1-b5e7-fbbeb7d18fec None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340/users/d91eb5338e8c49a5a59216db6b756f4f/roles/d3c2851744d94b809dac16599fa42789` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:27.416192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f0515-e71f-4dd1-b5e7-fbbeb7d18fec None admin] RBAC: Authorizing `identity:create_grant(project_id=cb46cdbaf65d4668a7a32126ba096340, user_id=d91eb5338e8c49a5a59216db6b756f4f, role_id=d3c2851744d94b809dac16599fa42789)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:27.417719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f0515-e71f-4dd1-b5e7-fbbeb7d18fec None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:27.439653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 76/148] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:45:27 2022] PUT /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340/users/d91eb5338e8c49a5a59216db6b756f4f/roles/d3c2851744d94b809dac16599fa42789 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:27.585213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca239-a050-4c06-88d1-dbbb33297ccd None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:27.585898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca239-a050-4c06-88d1-dbbb33297ccd None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:27.586382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca239-a050-4c06-88d1-dbbb33297ccd None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:27.588364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 73/149] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:27.594279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03014d9-f1f5-449d-9a44-18d3367452e6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:27.594577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03014d9-f1f5-449d-9a44-18d3367452e6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:27.594865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03014d9-f1f5-449d-9a44-18d3367452e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:27.618695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f03014d9-f1f5-449d-9a44-18d3367452e6 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:27.619866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f03014d9-f1f5-449d-9a44-18d3367452e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:27.710028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 77/150] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:27.756922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ca239-a050-4c06-88d1-dbbb33297ccd None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:27.867806 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ca239-a050-4c06-88d1-dbbb33297ccd None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:27.904171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046251-1bca-4e34-ba1f-fbe84fae09f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:27.905356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046251-1bca-4e34-ba1f-fbe84fae09f6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:27.905861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046251-1bca-4e34-ba1f-fbe84fae09f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:27.906341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046251-1bca-4e34-ba1f-fbe84fae09f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:27.917146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046251-1bca-4e34-ba1f-fbe84fae09f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-00046251-1bca-4e34-ba1f-fbe84fae09f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:27.925917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:27.926767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:27.927537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:27.933627 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 74/151] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:27.935646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03014d9-f1f5-449d-9a44-18d3367452e6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:28.070477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03014d9-f1f5-449d-9a44-18d3367452e6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:28.109336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd34ec-06ad-485a-a5f1-2a03f6bc3c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:28.110064 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd34ec-06ad-485a-a5f1-2a03f6bc3c76 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:28.110356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd34ec-06ad-485a-a5f1-2a03f6bc3c76 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:28.110639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd34ec-06ad-485a-a5f1-2a03f6bc3c76 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:28.111408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd34ec-06ad-485a-a5f1-2a03f6bc3c76 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:28.111723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd34ec-06ad-485a-a5f1-2a03f6bc3c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:28.113109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd34ec-06ad-485a-a5f1-2a03f6bc3c76 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:28.124685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 78/152] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:28.128400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046251-1bca-4e34-ba1f-fbe84fae09f6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:28.276223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046251-1bca-4e34-ba1f-fbe84fae09f6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:28.321219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14038f0-ab56-4776-bd40-aed6937a9259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:28.322138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14038f0-ab56-4776-bd40-aed6937a9259 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:28.322417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14038f0-ab56-4776-bd40-aed6937a9259 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:28.322685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14038f0-ab56-4776-bd40-aed6937a9259 None admin] PATH_INFO: `/v3/users/dcc5667f58514c749c19bbe4de82923c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:28.324453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14038f0-ab56-4776-bd40-aed6937a9259 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5667f58514c749c19bbe4de82923c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:28.325962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14038f0-ab56-4776-bd40-aed6937a9259 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:28.327597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 75/153] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:28 2022] GET /identity/v3/users/dcc5667f58514c749c19bbe4de82923c => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:28.333422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd34ec-06ad-485a-a5f1-2a03f6bc3c76 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:28.463218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd34ec-06ad-485a-a5f1-2a03f6bc3c76 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:28.501042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d4c69-3c0f-4ae1-9c35-1053846b2732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:28.501734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d4c69-3c0f-4ae1-9c35-1053846b2732 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:28.502026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d4c69-3c0f-4ae1-9c35-1053846b2732 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:28.502311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d4c69-3c0f-4ae1-9c35-1053846b2732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:28.585445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d4c69-3c0f-4ae1-9c35-1053846b2732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:28.586951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d4c69-3c0f-4ae1-9c35-1053846b2732 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:28.619145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c6594-1fe7-44e9-8934-e56a8270f8f4 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:28.619477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c6594-1fe7-44e9-8934-e56a8270f8f4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:28.619710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c6594-1fe7-44e9-8934-e56a8270f8f4 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:28.621132 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 76/154] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:28.630974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d836c8e-474e-4f95-96c8-b9ce6512a1b1 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:28.631252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d836c8e-474e-4f95-96c8-b9ce6512a1b1 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:28.631533 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d836c8e-474e-4f95-96c8-b9ce6512a1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:28.656838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1d836c8e-474e-4f95-96c8-b9ce6512a1b1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:28.662111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1d836c8e-474e-4f95-96c8-b9ce6512a1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:28.689420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 79/155] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:28.694471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d4c69-3c0f-4ae1-9c35-1053846b2732 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:28.752728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 77/156] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:28.796195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d836c8e-474e-4f95-96c8-b9ce6512a1b1 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:28.929086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d836c8e-474e-4f95-96c8-b9ce6512a1b1 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:28.931427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d4c69-3c0f-4ae1-9c35-1053846b2732 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:28.981608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40e7c3-c1b3-40ce-83f3-e7950c49a9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:28.982427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40e7c3-c1b3-40ce-83f3-e7950c49a9ee None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:28.982710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40e7c3-c1b3-40ce-83f3-e7950c49a9ee None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:28.982986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40e7c3-c1b3-40ce-83f3-e7950c49a9ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:28.996360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40e7c3-c1b3-40ce-83f3-e7950c49a9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-1e40e7c3-c1b3-40ce-83f3-e7950c49a9ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:29.009832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:29.012926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:29.014791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 78/157] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:45:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:29.021355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40e7c3-c1b3-40ce-83f3-e7950c49a9ee None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:29.026234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ce8fa-fad1-4654-9921-87f8c6221bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:29.027693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ce8fa-fad1-4654-9921-87f8c6221bdb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:29.027983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ce8fa-fad1-4654-9921-87f8c6221bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:29.028267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ce8fa-fad1-4654-9921-87f8c6221bdb None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:29.034283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ce8fa-fad1-4654-9921-87f8c6221bdb None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:29.035769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ce8fa-fad1-4654-9921-87f8c6221bdb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:29.037742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 80/158] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:28 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:29.050640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ce8fa-fad1-4654-9921-87f8c6221bdb None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:29.150743 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40e7c3-c1b3-40ce-83f3-e7950c49a9ee None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:29.193820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a4c73-96d4-43e3-ba8d-60290d48710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:29.194699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a4c73-96d4-43e3-ba8d-60290d48710f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:29.194987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a4c73-96d4-43e3-ba8d-60290d48710f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:29.195263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a4c73-96d4-43e3-ba8d-60290d48710f None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:29.196012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a4c73-96d4-43e3-ba8d-60290d48710f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:29.196322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a4c73-96d4-43e3-ba8d-60290d48710f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:29.197725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a4c73-96d4-43e3-ba8d-60290d48710f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:29.212192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 79/159] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:45:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:29.217970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a4c73-96d4-43e3-ba8d-60290d48710f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:29.321156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ce8fa-fad1-4654-9921-87f8c6221bdb None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:29.327577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a4c73-96d4-43e3-ba8d-60290d48710f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:29.375179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5d3cb-a807-41d4-bcbc-8fd716a1f133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:29.376073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5d3cb-a807-41d4-bcbc-8fd716a1f133 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:29.376356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5d3cb-a807-41d4-bcbc-8fd716a1f133 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:29.376631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5d3cb-a807-41d4-bcbc-8fd716a1f133 None admin] PATH_INFO: `/v3/users/dcc5667f58514c749c19bbe4de82923c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:29.377994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5d3cb-a807-41d4-bcbc-8fd716a1f133 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5667f58514c749c19bbe4de82923c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:29.379443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5d3cb-a807-41d4-bcbc-8fd716a1f133 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:29.381393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 80/160] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:29 2022] GET /identity/v3/users/dcc5667f58514c749c19bbe4de82923c => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:29.382608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6866c-0da3-4ab2-b41a-e8a3a451ef78 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:29.382890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6866c-0da3-4ab2-b41a-e8a3a451ef78 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:29.383278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6866c-0da3-4ab2-b41a-e8a3a451ef78 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:29.384746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 81/161] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:29.388927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e509f94-4f17-404d-9ee3-c83c102d7f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:29.389643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e509f94-4f17-404d-9ee3-c83c102d7f13 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:29.389923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e509f94-4f17-404d-9ee3-c83c102d7f13 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:29.390208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e509f94-4f17-404d-9ee3-c83c102d7f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:29.391073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e509f94-4f17-404d-9ee3-c83c102d7f13 None admin] RBAC: Adding query filter params (role.id=4a765555b657413ea79721175a7191e3, scope.project.id=cb46cdbaf65d4668a7a32126ba096340, user.id=dcc5667f58514c749c19bbe4de82923c) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:29.391391 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e509f94-4f17-404d-9ee3-c83c102d7f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:29.392837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e509f94-4f17-404d-9ee3-c83c102d7f13 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:29.394481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6866c-0da3-4ab2-b41a-e8a3a451ef78 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:29.399991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 81/162] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:29 2022] GET /identity/v3/role_assignments?user.id=dcc5667f58514c749c19bbe4de82923c&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=4a765555b657413ea79721175a7191e3 => generated 608 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:29.401356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b54a13-797b-4213-abe5-66377d2e9e97 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:29.402260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b54a13-797b-4213-abe5-66377d2e9e97 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:29.402550 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b54a13-797b-4213-abe5-66377d2e9e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:29.450177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c6b54a13-797b-4213-abe5-66377d2e9e97 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:29.451352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c6b54a13-797b-4213-abe5-66377d2e9e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:29.618217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 82/163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:29.628252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6866c-0da3-4ab2-b41a-e8a3a451ef78 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:29.666149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b98d55-872b-488c-85a4-59a1622669e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:29.666808 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b98d55-872b-488c-85a4-59a1622669e9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:29.667089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b98d55-872b-488c-85a4-59a1622669e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:29.667403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b98d55-872b-488c-85a4-59a1622669e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:29.735929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b54a13-797b-4213-abe5-66377d2e9e97 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:29.749322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b98d55-872b-488c-85a4-59a1622669e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:29.750856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b98d55-872b-488c-85a4-59a1622669e9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:29.900917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 82/164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:29.907157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b98d55-872b-488c-85a4-59a1622669e9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:30.036664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b98d55-872b-488c-85a4-59a1622669e9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:30.047917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b54a13-797b-4213-abe5-66377d2e9e97 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:30.081837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4fed1-96bd-42a6-baba-20d62d482aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:30.082708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4fed1-96bd-42a6-baba-20d62d482aa3 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:30.082985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4fed1-96bd-42a6-baba-20d62d482aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:30.083277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4fed1-96bd-42a6-baba-20d62d482aa3 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:30.090900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4fed1-96bd-42a6-baba-20d62d482aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:30.091876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4fed1-96bd-42a6-baba-20d62d482aa3 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:30.093976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 83/165] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:29 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:30.099586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4fed1-96bd-42a6-baba-20d62d482aa3 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:30.107110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c99f6-9f25-4187-9d3a-b3bc1e5836c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:30.107919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c99f6-9f25-4187-9d3a-b3bc1e5836c5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:30.108201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c99f6-9f25-4187-9d3a-b3bc1e5836c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:30.108475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c99f6-9f25-4187-9d3a-b3bc1e5836c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:30.123164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c99f6-9f25-4187-9d3a-b3bc1e5836c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-fe7c99f6-9f25-4187-9d3a-b3bc1e5836c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:30.132339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:30.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:30.134359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 83/166] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:30.138572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c99f6-9f25-4187-9d3a-b3bc1e5836c5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:30.242845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4fed1-96bd-42a6-baba-20d62d482aa3 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:30.271390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c99f6-9f25-4187-9d3a-b3bc1e5836c5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:30.284623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c8ebd-62da-4de9-bd32-dcec3761ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:30.285282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c8ebd-62da-4de9-bd32-dcec3761ac1b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:30.285582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c8ebd-62da-4de9-bd32-dcec3761ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:30.285864 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c8ebd-62da-4de9-bd32-dcec3761ac1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:30.286796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c8ebd-62da-4de9-bd32-dcec3761ac1b None admin] RBAC: Adding query filter params (role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=cb46cdbaf65d4668a7a32126ba096340, user.id=dcc5667f58514c749c19bbe4de82923c) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:30.287052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c8ebd-62da-4de9-bd32-dcec3761ac1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:30.288496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c8ebd-62da-4de9-bd32-dcec3761ac1b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:30.299352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 84/167] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:30 2022] GET /identity/v3/role_assignments?user.id=dcc5667f58514c749c19bbe4de82923c&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:30.313154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae369ff2-8568-4464-b627-b7a264c2fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:30.313887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae369ff2-8568-4464-b627-b7a264c2fab5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:30.314167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae369ff2-8568-4464-b627-b7a264c2fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:30.314442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae369ff2-8568-4464-b627-b7a264c2fab5 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:30.315210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae369ff2-8568-4464-b627-b7a264c2fab5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:30.315512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae369ff2-8568-4464-b627-b7a264c2fab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:30.316902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae369ff2-8568-4464-b627-b7a264c2fab5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:30.335356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 84/168] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:30.340644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c8ebd-62da-4de9-bd32-dcec3761ac1b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:30.498886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c8ebd-62da-4de9-bd32-dcec3761ac1b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:30.555467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ee2fd-a684-4182-beb0-d69dce8804a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:30.556269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ee2fd-a684-4182-beb0-d69dce8804a5 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:30.556545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ee2fd-a684-4182-beb0-d69dce8804a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:30.556815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ee2fd-a684-4182-beb0-d69dce8804a5 None admin] PATH_INFO: `/v3/users/39e02c8648054bf7b77e58c3e22a7e1e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:30.562285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ee2fd-a684-4182-beb0-d69dce8804a5 None admin] RBAC: Authorizing `identity:get_user(user_id=39e02c8648054bf7b77e58c3e22a7e1e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:30.563765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ee2fd-a684-4182-beb0-d69dce8804a5 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:30.565833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 85/169] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:30 2022] GET /identity/v3/users/39e02c8648054bf7b77e58c3e22a7e1e => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:30.571186 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae369ff2-8568-4464-b627-b7a264c2fab5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:30.721218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae369ff2-8568-4464-b627-b7a264c2fab5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:30.772687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2fa0a-086d-4458-b9da-3406e2f309ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:30.773348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2fa0a-086d-4458-b9da-3406e2f309ea None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:30.773657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2fa0a-086d-4458-b9da-3406e2f309ea None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:30.773932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2fa0a-086d-4458-b9da-3406e2f309ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:30.853806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2fa0a-086d-4458-b9da-3406e2f309ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:30.855868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2fa0a-086d-4458-b9da-3406e2f309ea None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:30.960386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 85/170] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:30.966615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ee2fd-a684-4182-beb0-d69dce8804a5 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:31.157293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ee2fd-a684-4182-beb0-d69dce8804a5 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:31.186193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7cd3-ceae-4267-a1c0-e4e2d5f5ab2f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.186493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7cd3-ceae-4267-a1c0-e4e2d5f5ab2f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.186756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7cd3-ceae-4267-a1c0-e4e2d5f5ab2f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.188125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 86/171] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:45:31.198112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8498-e4f5-42cd-83c0-a09f5adabd95 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.198439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8498-e4f5-42cd-83c0-a09f5adabd95 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.198698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8498-e4f5-42cd-83c0-a09f5adabd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.216786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91997817-2579-4ca3-9572-0308c5e0ccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:31.217681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997817-2579-4ca3-9572-0308c5e0ccc4 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.217962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997817-2579-4ca3-9572-0308c5e0ccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.218235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997817-2579-4ca3-9572-0308c5e0ccc4 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.220991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-693b8498-e4f5-42cd-83c0-a09f5adabd95 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:31.222290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91997817-2579-4ca3-9572-0308c5e0ccc4 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:31.223752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91997817-2579-4ca3-9572-0308c5e0ccc4 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:31.225741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 86/172] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:30 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:31.226279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-693b8498-e4f5-42cd-83c0-a09f5adabd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:31.231736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91997817-2579-4ca3-9572-0308c5e0ccc4 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:31.330916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91997817-2579-4ca3-9572-0308c5e0ccc4 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:31.342238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 87/173] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:31.343569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766635c5-33d7-44fd-ac69-a85a24be493b None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.343891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766635c5-33d7-44fd-ac69-a85a24be493b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.344121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766635c5-33d7-44fd-ac69-a85a24be493b None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.345379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 88/174] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:31.362963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dbe45-1e09-4f6a-a1c1-3503d9ef7f79 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.363236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dbe45-1e09-4f6a-a1c1-3503d9ef7f79 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.363515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dbe45-1e09-4f6a-a1c1-3503d9ef7f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.373053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cfb50-2443-4647-87c0-b0bbd3995507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:31.374035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cfb50-2443-4647-87c0-b0bbd3995507 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.374526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cfb50-2443-4647-87c0-b0bbd3995507 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.375063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cfb50-2443-4647-87c0-b0bbd3995507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.376138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cfb50-2443-4647-87c0-b0bbd3995507 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=cb46cdbaf65d4668a7a32126ba096340, user.id=39e02c8648054bf7b77e58c3e22a7e1e) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:31.376801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cfb50-2443-4647-87c0-b0bbd3995507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:31.378516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cfb50-2443-4647-87c0-b0bbd3995507 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:31.385268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 87/175] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:31 2022] GET /identity/v3/role_assignments?user.id=39e02c8648054bf7b77e58c3e22a7e1e&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=d03e020b3fb34446bbf5893b28904483 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:31.386489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cfb50-2443-4647-87c0-b0bbd3995507 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:31.403426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-181dbe45-1e09-4f6a-a1c1-3503d9ef7f79 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:31.404610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-181dbe45-1e09-4f6a-a1c1-3503d9ef7f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:31.497733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cfb50-2443-4647-87c0-b0bbd3995507 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:31.528629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 89/176] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:31.535394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c02e1-4bd2-4d53-aeef-57193947c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:31.536433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c02e1-4bd2-4d53-aeef-57193947c018 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.536927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c02e1-4bd2-4d53-aeef-57193947c018 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.537408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c02e1-4bd2-4d53-aeef-57193947c018 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.549679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c02e1-4bd2-4d53-aeef-57193947c018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-7d5c02e1-4bd2-4d53-aeef-57193947c018 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:31.558107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:31.559040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:31.559815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:31.562334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 88/177] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:31.569565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dbe45-1e09-4f6a-a1c1-3503d9ef7f79 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:31.583244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c02e1-4bd2-4d53-aeef-57193947c018 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:31.708782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dbe45-1e09-4f6a-a1c1-3503d9ef7f79 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:31.750502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54ba0d-2717-468c-b7cd-d2490ed7333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:31.751504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54ba0d-2717-468c-b7cd-d2490ed7333c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.751788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54ba0d-2717-468c-b7cd-d2490ed7333c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.752066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54ba0d-2717-468c-b7cd-d2490ed7333c None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.752904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54ba0d-2717-468c-b7cd-d2490ed7333c None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:31.753221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54ba0d-2717-468c-b7cd-d2490ed7333c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:31.755439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54ba0d-2717-468c-b7cd-d2490ed7333c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:31.768115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c02e1-4bd2-4d53-aeef-57193947c018 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:31.768447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 90/178] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:31.769433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ff25b-329f-4e53-99c9-4cdae32b653f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.769750 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ff25b-329f-4e53-99c9-4cdae32b653f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.770201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ff25b-329f-4e53-99c9-4cdae32b653f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.771714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 91/179] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:31.776440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ff25b-329f-4e53-99c9-4cdae32b653f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:31.816038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084328d-5b78-43c4-bc57-44d9cf9b241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:31.816851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084328d-5b78-43c4-bc57-44d9cf9b241e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.817138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084328d-5b78-43c4-bc57-44d9cf9b241e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.817413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084328d-5b78-43c4-bc57-44d9cf9b241e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.834960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084328d-5b78-43c4-bc57-44d9cf9b241e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-8084328d-5b78-43c4-bc57-44d9cf9b241e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:31.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:31.844145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:31.845097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 89/180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:31.846025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad786-8957-4f3d-ae14-1f58dba08ab5 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.846025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad786-8957-4f3d-ae14-1f58dba08ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.846258 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad786-8957-4f3d-ae14-1f58dba08ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.866432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e64ad786-8957-4f3d-ae14-1f58dba08ab5 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:31.869545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e64ad786-8957-4f3d-ae14-1f58dba08ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:31.904169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ff25b-329f-4e53-99c9-4cdae32b653f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:31.937952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc38b9-2afd-445c-bebd-9554ef701413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:31.938914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc38b9-2afd-445c-bebd-9554ef701413 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.939262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc38b9-2afd-445c-bebd-9554ef701413 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.939622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc38b9-2afd-445c-bebd-9554ef701413 None admin] PATH_INFO: `/v3/users/dcc5667f58514c749c19bbe4de82923c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.941575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 90/181] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:31.941575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60561785-4c29-4071-a741-6a73e2da7f8a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.941785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60561785-4c29-4071-a741-6a73e2da7f8a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.942065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60561785-4c29-4071-a741-6a73e2da7f8a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.942822 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc38b9-2afd-445c-bebd-9554ef701413 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5667f58514c749c19bbe4de82923c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:31.943245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 91/182] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:31.943999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60561785-4c29-4071-a741-6a73e2da7f8a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:31.944902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc38b9-2afd-445c-bebd-9554ef701413 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:31.947015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 92/183] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:31 2022] GET /identity/v3/users/dcc5667f58514c749c19bbe4de82923c => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:31.951603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607db083-0aba-46c1-a5ba-2f1ae21d0bfd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:31.952047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607db083-0aba-46c1-a5ba-2f1ae21d0bfd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:31.952484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607db083-0aba-46c1-a5ba-2f1ae21d0bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:31.973427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-607db083-0aba-46c1-a5ba-2f1ae21d0bfd None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:31.974610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-607db083-0aba-46c1-a5ba-2f1ae21d0bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:32.043291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 93/184] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:32.044202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607db083-0aba-46c1-a5ba-2f1ae21d0bfd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.050464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60561785-4c29-4071-a741-6a73e2da7f8a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.085199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34693d5c-7b97-4c8d-8c9f-ef88e3d30b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.085898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693d5c-7b97-4c8d-8c9f-ef88e3d30b83 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.086183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693d5c-7b97-4c8d-8c9f-ef88e3d30b83 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.086465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693d5c-7b97-4c8d-8c9f-ef88e3d30b83 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.087211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34693d5c-7b97-4c8d-8c9f-ef88e3d30b83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:32.087517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34693d5c-7b97-4c8d-8c9f-ef88e3d30b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:32.088889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34693d5c-7b97-4c8d-8c9f-ef88e3d30b83 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:32.101852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 92/185] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:32.101852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34693d5c-7b97-4c8d-8c9f-ef88e3d30b83 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.160241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607db083-0aba-46c1-a5ba-2f1ae21d0bfd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.193329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a603bd-6398-4ecf-8a84-686a70ee470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.194007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a603bd-6398-4ecf-8a84-686a70ee470b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.194290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a603bd-6398-4ecf-8a84-686a70ee470b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.194564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a603bd-6398-4ecf-8a84-686a70ee470b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.197823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34693d5c-7b97-4c8d-8c9f-ef88e3d30b83 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.229029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6119be0-5422-4a28-9873-96b112907dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.229787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6119be0-5422-4a28-9873-96b112907dec None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.230065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6119be0-5422-4a28-9873-96b112907dec None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.230332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6119be0-5422-4a28-9873-96b112907dec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.231485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6119be0-5422-4a28-9873-96b112907dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:32.232939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6119be0-5422-4a28-9873-96b112907dec None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:32.234552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 93/186] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:32.235300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6119be0-5422-4a28-9873-96b112907dec None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.262684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a603bd-6398-4ecf-8a84-686a70ee470b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:32.264173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a603bd-6398-4ecf-8a84-686a70ee470b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:32.327755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6119be0-5422-4a28-9873-96b112907dec None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.355518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 94/187] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:32.356983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a603bd-6398-4ecf-8a84-686a70ee470b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.360232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df802059-d8d9-4c92-ab60-4dd22209861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.361012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df802059-d8d9-4c92-ab60-4dd22209861d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.361286 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df802059-d8d9-4c92-ab60-4dd22209861d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.361583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df802059-d8d9-4c92-ab60-4dd22209861d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.371917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df802059-d8d9-4c92-ab60-4dd22209861d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-df802059-d8d9-4c92-ab60-4dd22209861d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:32.379462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:32.380335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:32.381130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:32.381760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 94/188] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:32.382457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ff171-ae6e-47a6-ab7b-a352465ff1f3 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.382736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ff171-ae6e-47a6-ab7b-a352465ff1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.383007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ff171-ae6e-47a6-ab7b-a352465ff1f3 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.384687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 95/189] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:32.384922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ff171-ae6e-47a6-ab7b-a352465ff1f3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.454598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a603bd-6398-4ecf-8a84-686a70ee470b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.486436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ad4c-5950-4b1d-9caf-d131e1ae6773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.487239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ad4c-5950-4b1d-9caf-d131e1ae6773 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.487526 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ad4c-5950-4b1d-9caf-d131e1ae6773 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.487804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ad4c-5950-4b1d-9caf-d131e1ae6773 None admin] PATH_INFO: `/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.488625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ff171-ae6e-47a6-ab7b-a352465ff1f3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.501457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ad4c-5950-4b1d-9caf-d131e1ae6773 None admin] RBAC: Authorizing `identity:get_user(user_id=48cb3953f24d4e91bc3629ecd9dc8ac5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:32.502982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ad4c-5950-4b1d-9caf-d131e1ae6773 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:32.504625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 95/190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:32 2022] GET /identity/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:32.505384 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ad4c-5950-4b1d-9caf-d131e1ae6773 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.521770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bd38c-305c-40dd-9b5f-2addc47a6119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.522435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bd38c-305c-40dd-9b5f-2addc47a6119 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.522710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bd38c-305c-40dd-9b5f-2addc47a6119 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.522992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bd38c-305c-40dd-9b5f-2addc47a6119 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.523695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bd38c-305c-40dd-9b5f-2addc47a6119 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:32.525142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bd38c-305c-40dd-9b5f-2addc47a6119 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:32.544699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 96/191] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:45:32 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:32.545621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bd38c-305c-40dd-9b5f-2addc47a6119 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.615935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ad4c-5950-4b1d-9caf-d131e1ae6773 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.652773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d0e3-a9e9-4f8f-b624-00a567938f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.653800 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d0e3-a9e9-4f8f-b624-00a567938f0b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.654152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d0e3-a9e9-4f8f-b624-00a567938f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.654496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d0e3-a9e9-4f8f-b624-00a567938f0b None admin] PATH_INFO: `/v3/projects/9898b4fa8385483581f379f9ce465677` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.655839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9d0e3-a9e9-4f8f-b624-00a567938f0b None admin] RBAC: Authorizing `identity:get_project(project_id=9898b4fa8385483581f379f9ce465677)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:32.656346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bd38c-305c-40dd-9b5f-2addc47a6119 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.657640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9d0e3-a9e9-4f8f-b624-00a567938f0b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:32.659500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 96/192] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:32 2022] GET /identity/v3/projects/9898b4fa8385483581f379f9ce465677 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:32.660799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0734a-897b-4654-b9f7-d9be606f073c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.661092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0734a-897b-4654-b9f7-d9be606f073c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.661369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0734a-897b-4654-b9f7-d9be606f073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.678671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-41f0734a-897b-4654-b9f7-d9be606f073c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:32.679907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-41f0734a-897b-4654-b9f7-d9be606f073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:32.696879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d81a6d-3793-4635-b355-2aee65adbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.697574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d81a6d-3793-4635-b355-2aee65adbe9a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.697860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d81a6d-3793-4635-b355-2aee65adbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.698140 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d81a6d-3793-4635-b355-2aee65adbe9a None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.699432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d81a6d-3793-4635-b355-2aee65adbe9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:32.699737 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d81a6d-3793-4635-b355-2aee65adbe9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:32.701159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d81a6d-3793-4635-b355-2aee65adbe9a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:32.710014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 97/193] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:32.710890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d81a6d-3793-4635-b355-2aee65adbe9a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.753376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 97/194] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:32.754192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0734a-897b-4654-b9f7-d9be606f073c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.840034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d81a6d-3793-4635-b355-2aee65adbe9a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.868752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0734a-897b-4654-b9f7-d9be606f073c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:32.887897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01763-a6f0-475e-bab2-19119fd2d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.888547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01763-a6f0-475e-bab2-19119fd2d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.888826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01763-a6f0-475e-bab2-19119fd2d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.889099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01763-a6f0-475e-bab2-19119fd2d8e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.918022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b95dca-ed6b-4f02-98f9-101c95b95527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:32.918688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b95dca-ed6b-4f02-98f9-101c95b95527 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:32.918970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b95dca-ed6b-4f02-98f9-101c95b95527 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:32.919245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b95dca-ed6b-4f02-98f9-101c95b95527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:32.920092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b95dca-ed6b-4f02-98f9-101c95b95527 None admin] RBAC: Adding query filter params (role.id=4a765555b657413ea79721175a7191e3, scope.project.id=9898b4fa8385483581f379f9ce465677, user.id=dcc5667f58514c749c19bbe4de82923c) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:32.920401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b95dca-ed6b-4f02-98f9-101c95b95527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:32.922156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b95dca-ed6b-4f02-98f9-101c95b95527 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:32.929048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 98/195] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:32 2022] GET /identity/v3/role_assignments?user.id=dcc5667f58514c749c19bbe4de82923c&scope.project.id=9898b4fa8385483581f379f9ce465677&role.id=4a765555b657413ea79721175a7191e3 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:32.929883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b95dca-ed6b-4f02-98f9-101c95b95527 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:32.971645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc01763-a6f0-475e-bab2-19119fd2d8e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:32.973329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc01763-a6f0-475e-bab2-19119fd2d8e9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:33.061440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b95dca-ed6b-4f02-98f9-101c95b95527 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:33.088338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 98/196] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:33.089571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01763-a6f0-475e-bab2-19119fd2d8e9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:33.096530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567189b9-6b6d-45ec-9ffd-2f60ad4cc023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:33.097422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567189b9-6b6d-45ec-9ffd-2f60ad4cc023 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:33.097742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567189b9-6b6d-45ec-9ffd-2f60ad4cc023 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:33.098020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567189b9-6b6d-45ec-9ffd-2f60ad4cc023 None admin] PATH_INFO: `/v3/users/d91eb5338e8c49a5a59216db6b756f4f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:33.099371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567189b9-6b6d-45ec-9ffd-2f60ad4cc023 None admin] RBAC: Authorizing `identity:get_user(user_id=d91eb5338e8c49a5a59216db6b756f4f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:33.100854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567189b9-6b6d-45ec-9ffd-2f60ad4cc023 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:33.102905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 99/197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:32 2022] GET /identity/v3/users/d91eb5338e8c49a5a59216db6b756f4f => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:33.103696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567189b9-6b6d-45ec-9ffd-2f60ad4cc023 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:33.207495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567189b9-6b6d-45ec-9ffd-2f60ad4cc023 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:33.213015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01763-a6f0-475e-bab2-19119fd2d8e9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:33.250392 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6ac4c-6f5b-4cec-a7ae-dfc11d3d5e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:33.251291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6ac4c-6f5b-4cec-a7ae-dfc11d3d5e98 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:33.251573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6ac4c-6f5b-4cec-a7ae-dfc11d3d5e98 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:33.251847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6ac4c-6f5b-4cec-a7ae-dfc11d3d5e98 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:33.258116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6ac4c-6f5b-4cec-a7ae-dfc11d3d5e98 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:33.260316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6ac4c-6f5b-4cec-a7ae-dfc11d3d5e98 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:33.264801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 100/198] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:33 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:33.266315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6ac4c-6f5b-4cec-a7ae-dfc11d3d5e98 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:33.268027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee0ab1-3531-4149-a25b-b5a761793d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:33.269096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee0ab1-3531-4149-a25b-b5a761793d62 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:33.269625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee0ab1-3531-4149-a25b-b5a761793d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:33.270118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee0ab1-3531-4149-a25b-b5a761793d62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:33.291229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee0ab1-3531-4149-a25b-b5a761793d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-65ee0ab1-3531-4149-a25b-b5a761793d62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:33.301644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:33.302597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:33.303401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 99/199] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:45:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:33.304072 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee0ab1-3531-4149-a25b-b5a761793d62 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:33.395958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6ac4c-6f5b-4cec-a7ae-dfc11d3d5e98 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:33.411811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee0ab1-3531-4149-a25b-b5a761793d62 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:33.430334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d115a3-5f92-4ae2-b32e-d80e58246f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:33.430990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d115a3-5f92-4ae2-b32e-d80e58246f4b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:33.431277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d115a3-5f92-4ae2-b32e-d80e58246f4b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:33.431557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d115a3-5f92-4ae2-b32e-d80e58246f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:33.456057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1837c-609f-4ee9-830d-53b0791cb745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:33.456720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1837c-609f-4ee9-830d-53b0791cb745 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:33.457003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1837c-609f-4ee9-830d-53b0791cb745 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:33.457277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1837c-609f-4ee9-830d-53b0791cb745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:33.458155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1837c-609f-4ee9-830d-53b0791cb745 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=6c9ffaa9059441daacf4f61653c20168, user.id=48cb3953f24d4e91bc3629ecd9dc8ac5) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:33.458467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1837c-609f-4ee9-830d-53b0791cb745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:33.459922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1837c-609f-4ee9-830d-53b0791cb745 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:33.466028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 100/200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:33 2022] GET /identity/v3/role_assignments?user.id=48cb3953f24d4e91bc3629ecd9dc8ac5&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=d03e020b3fb34446bbf5893b28904483 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:33.466844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1837c-609f-4ee9-830d-53b0791cb745 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:33.506151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d115a3-5f92-4ae2-b32e-d80e58246f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:33.507650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d115a3-5f92-4ae2-b32e-d80e58246f4b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:33.582715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1837c-609f-4ee9-830d-53b0791cb745 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:33.644135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 101/201] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:33.649631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2c91-f94a-42f1-aba4-e0edbd3d89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:33.650903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2c91-f94a-42f1-aba4-e0edbd3d89ef None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:33.651384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2c91-f94a-42f1-aba4-e0edbd3d89ef None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:33.652407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2c91-f94a-42f1-aba4-e0edbd3d89ef None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:33.653367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a2c91-f94a-42f1-aba4-e0edbd3d89ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:33.653905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a2c91-f94a-42f1-aba4-e0edbd3d89ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:33.655510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a2c91-f94a-42f1-aba4-e0edbd3d89ef None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:33.659661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d115a3-5f92-4ae2-b32e-d80e58246f4b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:33.678482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 101/202] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:45:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:33.686213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2c91-f94a-42f1-aba4-e0edbd3d89ef None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:33.844201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d115a3-5f92-4ae2-b32e-d80e58246f4b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:33.866986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2c91-f94a-42f1-aba4-e0edbd3d89ef None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:33.903162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a02ba0-faa8-440f-bb0a-f49a16f280c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:33.903971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a02ba0-faa8-440f-bb0a-f49a16f280c1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:33.904257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a02ba0-faa8-440f-bb0a-f49a16f280c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:33.904533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a02ba0-faa8-440f-bb0a-f49a16f280c1 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:33.905870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a02ba0-faa8-440f-bb0a-f49a16f280c1 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:33.907337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a02ba0-faa8-440f-bb0a-f49a16f280c1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:33.909228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 102/203] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:33 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:33.915960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a02ba0-faa8-440f-bb0a-f49a16f280c1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:33.926035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563aa8a-127d-4430-976e-65105e393636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:33.926916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563aa8a-127d-4430-976e-65105e393636 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:33.927204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563aa8a-127d-4430-976e-65105e393636 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:33.927480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563aa8a-127d-4430-976e-65105e393636 None admin] PATH_INFO: `/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:33.932565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563aa8a-127d-4430-976e-65105e393636 None admin] RBAC: Authorizing `identity:get_user(user_id=48cb3953f24d4e91bc3629ecd9dc8ac5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:33.935889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563aa8a-127d-4430-976e-65105e393636 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:33.941183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 102/204] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:33 2022] GET /identity/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:33.944437 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563aa8a-127d-4430-976e-65105e393636 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:34.066290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563aa8a-127d-4430-976e-65105e393636 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:34.109562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b62d68-0881-42fa-9174-11593df05b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:34.109562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b62d68-0881-42fa-9174-11593df05b47 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:34.109562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b62d68-0881-42fa-9174-11593df05b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:34.109562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b62d68-0881-42fa-9174-11593df05b47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:34.163775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a02ba0-faa8-440f-bb0a-f49a16f280c1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:34.200221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b62d68-0881-42fa-9174-11593df05b47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:34.201909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b62d68-0881-42fa-9174-11593df05b47 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:34.270952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227834-ed0f-4284-b37a-61916511901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:34.271961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227834-ed0f-4284-b37a-61916511901a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:34.272463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227834-ed0f-4284-b37a-61916511901a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:34.272931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227834-ed0f-4284-b37a-61916511901a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:34.273994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227834-ed0f-4284-b37a-61916511901a None admin] RBAC: Adding query filter params (role.id=d3c2851744d94b809dac16599fa42789, scope.project.id=cb46cdbaf65d4668a7a32126ba096340, user.id=d91eb5338e8c49a5a59216db6b756f4f) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:34.274501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227834-ed0f-4284-b37a-61916511901a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:34.276120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227834-ed0f-4284-b37a-61916511901a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:34.293796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 103/205] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:33 2022] GET /identity/v3/role_assignments?user.id=d91eb5338e8c49a5a59216db6b756f4f&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=d3c2851744d94b809dac16599fa42789 => generated 608 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:34.307164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 103/206] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:34.313905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227834-ed0f-4284-b37a-61916511901a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:34.462925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227834-ed0f-4284-b37a-61916511901a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:34.511314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf8e35-ba49-462c-a289-bb11f26ca8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:34.512587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf8e35-ba49-462c-a289-bb11f26ca8e5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:34.513067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf8e35-ba49-462c-a289-bb11f26ca8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:34.513562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf8e35-ba49-462c-a289-bb11f26ca8e5 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:34.515036 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf8e35-ba49-462c-a289-bb11f26ca8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:34.516736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf8e35-ba49-462c-a289-bb11f26ca8e5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:34.518838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 104/207] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:34 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:34.524938 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b62d68-0881-42fa-9174-11593df05b47 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:34.638323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b62d68-0881-42fa-9174-11593df05b47 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:34.673137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cecf6-5999-4a56-a2ff-88a299f45afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:34.673822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cecf6-5999-4a56-a2ff-88a299f45afa None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:34.674105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cecf6-5999-4a56-a2ff-88a299f45afa None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:34.674381 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cecf6-5999-4a56-a2ff-88a299f45afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:34.675216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cecf6-5999-4a56-a2ff-88a299f45afa None admin] RBAC: Adding query filter params (role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=6c9ffaa9059441daacf4f61653c20168, user.id=48cb3953f24d4e91bc3629ecd9dc8ac5) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:34.675524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cecf6-5999-4a56-a2ff-88a299f45afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:34.676998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cecf6-5999-4a56-a2ff-88a299f45afa None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:34.683624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 104/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:34 2022] GET /identity/v3/role_assignments?user.id=48cb3953f24d4e91bc3629ecd9dc8ac5&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:35.153544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13fbc-0866-4f79-a71e-530028429969 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.153845 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13fbc-0866-4f79-a71e-530028429969 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.154106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13fbc-0866-4f79-a71e-530028429969 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:35.155746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 105/209] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:35.161061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf81e3-2bed-4ee7-8623-8ba2cb084938 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.161619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf81e3-2bed-4ee7-8623-8ba2cb084938 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.162122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf81e3-2bed-4ee7-8623-8ba2cb084938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:35.185105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-3baf81e3-2bed-4ee7-8623-8ba2cb084938 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:35.186656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3baf81e3-2bed-4ee7-8623-8ba2cb084938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:35.252750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 105/210] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:35.259131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413841a-e86e-494e-aac4-1d91ef8e1668 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.259424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413841a-e86e-494e-aac4-1d91ef8e1668 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.259710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413841a-e86e-494e-aac4-1d91ef8e1668 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:35.261670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 106/211] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:35.267258 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ead-1feb-4dc1-8e4d-56dd9caf09ab None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.267549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ead-1feb-4dc1-8e4d-56dd9caf09ab None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.267823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ead-1feb-4dc1-8e4d-56dd9caf09ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:35.278536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413841a-e86e-494e-aac4-1d91ef8e1668 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:35.283935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-209b8ead-1feb-4dc1-8e4d-56dd9caf09ab None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:35.285279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-209b8ead-1feb-4dc1-8e4d-56dd9caf09ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:35.355148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 106/212] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:35.380359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ead-1feb-4dc1-8e4d-56dd9caf09ab None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:35.396414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413841a-e86e-494e-aac4-1d91ef8e1668 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:35.431001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27de41-80b8-41bd-84c9-fc887b41aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:35.432168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27de41-80b8-41bd-84c9-fc887b41aba4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.433232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27de41-80b8-41bd-84c9-fc887b41aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.433643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27de41-80b8-41bd-84c9-fc887b41aba4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:35.444054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27de41-80b8-41bd-84c9-fc887b41aba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-2e27de41-80b8-41bd-84c9-fc887b41aba4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:35.452665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:35.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:35.454485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:35.456812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 107/213] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:35.463600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27de41-80b8-41bd-84c9-fc887b41aba4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:35.497392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ead-1feb-4dc1-8e4d-56dd9caf09ab None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:35.533335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348737da-5d7d-42eb-957c-f9c0953f28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:35.534523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348737da-5d7d-42eb-957c-f9c0953f28aa None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.535040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348737da-5d7d-42eb-957c-f9c0953f28aa None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.535515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348737da-5d7d-42eb-957c-f9c0953f28aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:35.536887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348737da-5d7d-42eb-957c-f9c0953f28aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:35.538584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348737da-5d7d-42eb-957c-f9c0953f28aa None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:35.545657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 107/214] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:35.547368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348737da-5d7d-42eb-957c-f9c0953f28aa None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:35.584444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27de41-80b8-41bd-84c9-fc887b41aba4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:35.619005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c9a16-6ca2-43d0-b999-60d16aca7671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:35.620039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c9a16-6ca2-43d0-b999-60d16aca7671 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.621090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c9a16-6ca2-43d0-b999-60d16aca7671 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.621597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c9a16-6ca2-43d0-b999-60d16aca7671 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:35.622554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c9a16-6ca2-43d0-b999-60d16aca7671 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:35.623059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c9a16-6ca2-43d0-b999-60d16aca7671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:35.624656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c9a16-6ca2-43d0-b999-60d16aca7671 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:35.632965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 108/215] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:35.638436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c9a16-6ca2-43d0-b999-60d16aca7671 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:35.664089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348737da-5d7d-42eb-957c-f9c0953f28aa None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:35.701240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfd0bb-938e-4a56-a75b-945f02a67f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:35.701960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd0bb-938e-4a56-a75b-945f02a67f71 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.702241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd0bb-938e-4a56-a75b-945f02a67f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.702596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd0bb-938e-4a56-a75b-945f02a67f71 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:35.703316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfd0bb-938e-4a56-a75b-945f02a67f71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:35.704834 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfd0bb-938e-4a56-a75b-945f02a67f71 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:35.731875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 108/216] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:45:35 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:45:35.761227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c9a16-6ca2-43d0-b999-60d16aca7671 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:35.798726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6b8b4-4cca-47ff-8ad3-3d2d07abca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:35.800117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b8b4-4cca-47ff-8ad3-3d2d07abca2d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.800609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b8b4-4cca-47ff-8ad3-3d2d07abca2d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.801118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b8b4-4cca-47ff-8ad3-3d2d07abca2d None admin] PATH_INFO: `/v3/users/36dea8131fe648039507a66f446798f5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:35.817233 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6b8b4-4cca-47ff-8ad3-3d2d07abca2d None admin] RBAC: Authorizing `identity:get_user(user_id=36dea8131fe648039507a66f446798f5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:35.819080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6b8b4-4cca-47ff-8ad3-3d2d07abca2d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:35.821410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 109/217] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:35 2022] GET /identity/v3/users/36dea8131fe648039507a66f446798f5 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:35.827214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfd0bb-938e-4a56-a75b-945f02a67f71 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:35.942381 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfd0bb-938e-4a56-a75b-945f02a67f71 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:35.976571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00485d-3779-45bb-a03a-fefae03b35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:35.977448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00485d-3779-45bb-a03a-fefae03b35b8 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:35.977894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00485d-3779-45bb-a03a-fefae03b35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:35.978314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00485d-3779-45bb-a03a-fefae03b35b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:36.050888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00485d-3779-45bb-a03a-fefae03b35b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:36.052643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00485d-3779-45bb-a03a-fefae03b35b8 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:36.097279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799555cf-cf32-46d1-a460-93ff4ab25ddb None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:36.097603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799555cf-cf32-46d1-a460-93ff4ab25ddb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:36.097869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799555cf-cf32-46d1-a460-93ff4ab25ddb None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:36.099514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 110/218] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:36.105861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680f35-a8ca-434f-af5c-b90e2a610252 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:36.106154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680f35-a8ca-434f-af5c-b90e2a610252 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:36.106435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680f35-a8ca-434f-af5c-b90e2a610252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:36.134283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-65680f35-a8ca-434f-af5c-b90e2a610252 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:36.135370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-65680f35-a8ca-434f-af5c-b90e2a610252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:36.165135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:36.171301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00485d-3779-45bb-a03a-fefae03b35b8 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:36.221818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 111/220] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:36.245634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680f35-a8ca-434f-af5c-b90e2a610252 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:36.277304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00485d-3779-45bb-a03a-fefae03b35b8 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:36.313590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819efb8-9c72-40b5-ad60-e0d95c269673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:36.314464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819efb8-9c72-40b5-ad60-e0d95c269673 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:36.314744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819efb8-9c72-40b5-ad60-e0d95c269673 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:36.315018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819efb8-9c72-40b5-ad60-e0d95c269673 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:36.316243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819efb8-9c72-40b5-ad60-e0d95c269673 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:36.317725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819efb8-9c72-40b5-ad60-e0d95c269673 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:36.319734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 110/221] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:36 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:36.326873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819efb8-9c72-40b5-ad60-e0d95c269673 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:36.379451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680f35-a8ca-434f-af5c-b90e2a610252 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:36.439204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819efb8-9c72-40b5-ad60-e0d95c269673 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:36.453001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b59634-139d-4ab4-8987-45b7d0d98ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:36.453904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b59634-139d-4ab4-8987-45b7d0d98ae1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:36.454191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b59634-139d-4ab4-8987-45b7d0d98ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:36.454472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b59634-139d-4ab4-8987-45b7d0d98ae1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:36.476677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838860-155d-403f-a604-559205e73699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:36.477267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838860-155d-403f-a604-559205e73699 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:36.479759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838860-155d-403f-a604-559205e73699 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:36.479759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838860-155d-403f-a604-559205e73699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:36.479759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6838860-155d-403f-a604-559205e73699 None admin] RBAC: Adding query filter params (role.id=4a765555b657413ea79721175a7191e3, scope.project.id=6c9ffaa9059441daacf4f61653c20168, user.id=36dea8131fe648039507a66f446798f5) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:36.479759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6838860-155d-403f-a604-559205e73699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:36.480452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6838860-155d-403f-a604-559205e73699 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:36.481580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b59634-139d-4ab4-8987-45b7d0d98ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-16b59634-139d-4ab4-8987-45b7d0d98ae1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:36.489247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:36.490170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:36.491003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:36.492029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 112/222] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:36.497264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b59634-139d-4ab4-8987-45b7d0d98ae1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:36.503651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 111/223] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:36 2022] GET /identity/v3/role_assignments?user.id=36dea8131fe648039507a66f446798f5&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=4a765555b657413ea79721175a7191e3 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:36.606251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b59634-139d-4ab4-8987-45b7d0d98ae1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:36.641560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c9b04-500e-4e86-81a4-07076b9acff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:36.642264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c9b04-500e-4e86-81a4-07076b9acff0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:36.642825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c9b04-500e-4e86-81a4-07076b9acff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:36.643101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c9b04-500e-4e86-81a4-07076b9acff0 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:36.643852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c9b04-500e-4e86-81a4-07076b9acff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:36.644162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c9b04-500e-4e86-81a4-07076b9acff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:36.645552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c9b04-500e-4e86-81a4-07076b9acff0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:36.655077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 113/224] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:36.660675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838860-155d-403f-a604-559205e73699 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:36.777941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838860-155d-403f-a604-559205e73699 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:36.812401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dedb4-6d39-473a-8d1a-c1514df67b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:36.813276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dedb4-6d39-473a-8d1a-c1514df67b8a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:36.813565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dedb4-6d39-473a-8d1a-c1514df67b8a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:36.813843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dedb4-6d39-473a-8d1a-c1514df67b8a None admin] PATH_INFO: `/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:36.815028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dedb4-6d39-473a-8d1a-c1514df67b8a None admin] RBAC: Authorizing `identity:get_user(user_id=48cb3953f24d4e91bc3629ecd9dc8ac5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:36.816469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dedb4-6d39-473a-8d1a-c1514df67b8a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:36.818413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 112/225] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:36 2022] GET /identity/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:36.824377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c9b04-500e-4e86-81a4-07076b9acff0 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:36.929079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c9b04-500e-4e86-81a4-07076b9acff0 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:36.963448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692561-14ab-409f-b141-a6eeb2daa471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:36.964348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692561-14ab-409f-b141-a6eeb2daa471 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:36.964627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692561-14ab-409f-b141-a6eeb2daa471 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:36.964896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692561-14ab-409f-b141-a6eeb2daa471 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:36.966106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3692561-14ab-409f-b141-a6eeb2daa471 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:36.967535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3692561-14ab-409f-b141-a6eeb2daa471 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:36.969550 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 114/226] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:36 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:36.978590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dedb4-6d39-473a-8d1a-c1514df67b8a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:37.106615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dedb4-6d39-473a-8d1a-c1514df67b8a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:37.144996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f82a1-d0ef-49ab-a342-ec0f6b86582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:37.145916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f82a1-d0ef-49ab-a342-ec0f6b86582c None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:37.146196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f82a1-d0ef-49ab-a342-ec0f6b86582c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:37.146470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f82a1-d0ef-49ab-a342-ec0f6b86582c None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168/users/48cb3953f24d4e91bc3629ecd9dc8ac5/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:37.150816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f82a1-d0ef-49ab-a342-ec0f6b86582c None admin] RBAC: Authorizing `identity:create_grant(project_id=6c9ffaa9059441daacf4f61653c20168, user_id=48cb3953f24d4e91bc3629ecd9dc8ac5, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:37.152314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f82a1-d0ef-49ab-a342-ec0f6b86582c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:37.169932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 113/227] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:45:36 2022] PUT /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168/users/48cb3953f24d4e91bc3629ecd9dc8ac5/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:37.186570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43422f-8024-42fe-8081-69880a542cb9 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:37.186923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43422f-8024-42fe-8081-69880a542cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:37.187122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43422f-8024-42fe-8081-69880a542cb9 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:37.188893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 115/228] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:37.194396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd64493-e0ad-4f5c-8bff-1e5b31653a4c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:37.194736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd64493-e0ad-4f5c-8bff-1e5b31653a4c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:37.195017 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd64493-e0ad-4f5c-8bff-1e5b31653a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:37.222222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4cd64493-e0ad-4f5c-8bff-1e5b31653a4c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:37.223453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4cd64493-e0ad-4f5c-8bff-1e5b31653a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:37.311288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 114/229] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:37.342096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43422f-8024-42fe-8081-69880a542cb9 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:37.478634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43422f-8024-42fe-8081-69880a542cb9 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:37.522708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16b496-c603-49d7-8125-47a008b24044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:37.524330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16b496-c603-49d7-8125-47a008b24044 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:37.524836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16b496-c603-49d7-8125-47a008b24044 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:37.525329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16b496-c603-49d7-8125-47a008b24044 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:37.535802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16b496-c603-49d7-8125-47a008b24044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ba16b496-c603-49d7-8125-47a008b24044 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:37.544449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:37.545393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:37.546217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:37.549344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:45:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:37.561139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd64493-e0ad-4f5c-8bff-1e5b31653a4c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:37.675044 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd64493-e0ad-4f5c-8bff-1e5b31653a4c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:37.718016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667d1e9-92e7-4440-855c-71eb0669e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:37.719064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667d1e9-92e7-4440-855c-71eb0669e617 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:37.719547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667d1e9-92e7-4440-855c-71eb0669e617 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:37.720019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667d1e9-92e7-4440-855c-71eb0669e617 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:37.720980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667d1e9-92e7-4440-855c-71eb0669e617 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:37.721485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667d1e9-92e7-4440-855c-71eb0669e617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:37.723122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667d1e9-92e7-4440-855c-71eb0669e617 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:37.737551 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 115/231] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:45:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:37.742687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16b496-c603-49d7-8125-47a008b24044 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:37.856432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16b496-c603-49d7-8125-47a008b24044 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:37.891144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a3423-ad8e-45ed-857c-248ae87d0140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:37.892050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a3423-ad8e-45ed-857c-248ae87d0140 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:37.892334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a3423-ad8e-45ed-857c-248ae87d0140 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:37.892609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a3423-ad8e-45ed-857c-248ae87d0140 None admin] PATH_INFO: `/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:37.893869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a3423-ad8e-45ed-857c-248ae87d0140 None admin] RBAC: Authorizing `identity:get_user(user_id=48cb3953f24d4e91bc3629ecd9dc8ac5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:37.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a3423-ad8e-45ed-857c-248ae87d0140 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:37.898436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 117/232] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:37 2022] GET /identity/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:37.904273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667d1e9-92e7-4440-855c-71eb0669e617 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:38.055080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667d1e9-92e7-4440-855c-71eb0669e617 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:38.102023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e530-f1ab-4f4f-adb4-8b472df2ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:38.103238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e530-f1ab-4f4f-adb4-8b472df2ca04 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:38.103770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e530-f1ab-4f4f-adb4-8b472df2ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:38.104239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e530-f1ab-4f4f-adb4-8b472df2ca04 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:38.110249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e530-f1ab-4f4f-adb4-8b472df2ca04 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:38.111921 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e530-f1ab-4f4f-adb4-8b472df2ca04 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:38.114202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 116/233] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:37 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:38.119621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a3423-ad8e-45ed-857c-248ae87d0140 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:38.288083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a3423-ad8e-45ed-857c-248ae87d0140 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:38.334106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d489e3-d517-4746-a6a4-47bd8730ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:38.335352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d489e3-d517-4746-a6a4-47bd8730ffb0 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:38.335849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d489e3-d517-4746-a6a4-47bd8730ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:38.336317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d489e3-d517-4746-a6a4-47bd8730ffb0 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168/users/48cb3953f24d4e91bc3629ecd9dc8ac5/roles/ee5d57f7c4704b3d907933236c98c2c2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:38.343345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d489e3-d517-4746-a6a4-47bd8730ffb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c9ffaa9059441daacf4f61653c20168, user_id=48cb3953f24d4e91bc3629ecd9dc8ac5, role_id=ee5d57f7c4704b3d907933236c98c2c2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:38.345008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d489e3-d517-4746-a6a4-47bd8730ffb0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:38.364974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:45:38 2022] PUT /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168/users/48cb3953f24d4e91bc3629ecd9dc8ac5/roles/ee5d57f7c4704b3d907933236c98c2c2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:38.569755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc56a0-d6c1-4da5-9ce5-bb856b76e6e1 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:38.570772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc56a0-d6c1-4da5-9ce5-bb856b76e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:38.571259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc56a0-d6c1-4da5-9ce5-bb856b76e6e1 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:38.573781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 117/235] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:38.579050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd47d6-64fa-41ca-803d-ca52a7c9a6bb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:38.579940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd47d6-64fa-41ca-803d-ca52a7c9a6bb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:38.580404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd47d6-64fa-41ca-803d-ca52a7c9a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:38.606781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5bbd47d6-64fa-41ca-803d-ca52a7c9a6bb None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:38.608294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5bbd47d6-64fa-41ca-803d-ca52a7c9a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:38.686042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 119/236] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:38.710481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc56a0-d6c1-4da5-9ce5-bb856b76e6e1 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:38.834231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc56a0-d6c1-4da5-9ce5-bb856b76e6e1 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:38.879836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee29cfd-7a27-424c-8cde-f765cfdceb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:38.880591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29cfd-7a27-424c-8cde-f765cfdceb9c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:38.880870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29cfd-7a27-424c-8cde-f765cfdceb9c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:38.881142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29cfd-7a27-424c-8cde-f765cfdceb9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:38.900551 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee29cfd-7a27-424c-8cde-f765cfdceb9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-6ee29cfd-7a27-424c-8cde-f765cfdceb9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:38.914319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:38.915278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:38.916510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 118/237] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:38.926739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd47d6-64fa-41ca-803d-ca52a7c9a6bb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:39.082490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd47d6-64fa-41ca-803d-ca52a7c9a6bb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:39.114889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f168882-5421-4ec4-9db9-587be95388a5 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.115855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f168882-5421-4ec4-9db9-587be95388a5 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.116351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f168882-5421-4ec4-9db9-587be95388a5 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.117969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 119/238] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:39.124771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce6755-cada-4ff2-a295-b461738a9f15 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.125059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce6755-cada-4ff2-a295-b461738a9f15 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.125498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce6755-cada-4ff2-a295-b461738a9f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.140147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e07d4-5939-41d0-968b-341827b1d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:39.140825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e07d4-5939-41d0-968b-341827b1d2ba None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.141109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e07d4-5939-41d0-968b-341827b1d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.141383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e07d4-5939-41d0-968b-341827b1d2ba None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.142176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e07d4-5939-41d0-968b-341827b1d2ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:39.142484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e07d4-5939-41d0-968b-341827b1d2ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:39.144323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e07d4-5939-41d0-968b-341827b1d2ba None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:39.153039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 120/239] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:39.154828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-cdce6755-cada-4ff2-a295-b461738a9f15 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:39.156021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-cdce6755-cada-4ff2-a295-b461738a9f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:39.158610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e07d4-5939-41d0-968b-341827b1d2ba None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:39.240206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 120/240] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:39.264937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce6755-cada-4ff2-a295-b461738a9f15 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:39.314587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e07d4-5939-41d0-968b-341827b1d2ba None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:39.353600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01127-9584-4787-a643-73725a6402cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:39.355877 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01127-9584-4787-a643-73725a6402cb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.356310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01127-9584-4787-a643-73725a6402cb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.356729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01127-9584-4787-a643-73725a6402cb None admin] PATH_INFO: `/v3/users/28bfe97c81904d7994481ac47b12207c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.373137 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b01127-9584-4787-a643-73725a6402cb None admin] RBAC: Authorizing `identity:get_user(user_id=28bfe97c81904d7994481ac47b12207c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:39.375490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b01127-9584-4787-a643-73725a6402cb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:39.382703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 121/241] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:39 2022] GET /identity/v3/users/28bfe97c81904d7994481ac47b12207c => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:39.383125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dedb4c-2dde-4b40-a39a-f7199d74934c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.383318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dedb4c-2dde-4b40-a39a-f7199d74934c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.383550 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dedb4c-2dde-4b40-a39a-f7199d74934c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.384990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 122/242] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:39.385540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dedb4c-2dde-4b40-a39a-f7199d74934c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:39.398548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce6755-cada-4ff2-a295-b461738a9f15 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:39.441095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4163044-7fd6-4c6f-9c15-7c035e019b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:39.442586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4163044-7fd6-4c6f-9c15-7c035e019b8a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.443060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4163044-7fd6-4c6f-9c15-7c035e019b8a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.443730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4163044-7fd6-4c6f-9c15-7c035e019b8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.445518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4163044-7fd6-4c6f-9c15-7c035e019b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:39.447478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4163044-7fd6-4c6f-9c15-7c035e019b8a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:39.449995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 121/243] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:39.451757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99518-4c89-4b46-9460-6ff257b924c2 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.452468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99518-4c89-4b46-9460-6ff257b924c2 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.452907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99518-4c89-4b46-9460-6ff257b924c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.479158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-8fa99518-4c89-4b46-9460-6ff257b924c2 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:39.481776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8fa99518-4c89-4b46-9460-6ff257b924c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:39.500413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dedb4c-2dde-4b40-a39a-f7199d74934c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:39.535769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a503a77-dc30-49b6-bfb5-b82c41764099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:39.536334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503a77-dc30-49b6-bfb5-b82c41764099 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.536718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503a77-dc30-49b6-bfb5-b82c41764099 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.537094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503a77-dc30-49b6-bfb5-b82c41764099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.568147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 122/244] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:39.569482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa99518-4c89-4b46-9460-6ff257b924c2 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:39.605790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a503a77-dc30-49b6-bfb5-b82c41764099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:39.607406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a503a77-dc30-49b6-bfb5-b82c41764099 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:39.690826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa99518-4c89-4b46-9460-6ff257b924c2 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:39.708641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 123/245] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:39.710767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a503a77-dc30-49b6-bfb5-b82c41764099 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:39.728358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1425b7-74e2-46e3-b994-24670fa8f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:39.729241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1425b7-74e2-46e3-b994-24670fa8f58a None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.730259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1425b7-74e2-46e3-b994-24670fa8f58a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.730694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1425b7-74e2-46e3-b994-24670fa8f58a None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.731596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1425b7-74e2-46e3-b994-24670fa8f58a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:39.733211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1425b7-74e2-46e3-b994-24670fa8f58a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:39.756869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 123/246] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:45:39 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:39.758859 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1425b7-74e2-46e3-b994-24670fa8f58a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:39.881579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a503a77-dc30-49b6-bfb5-b82c41764099 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:39.881776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1425b7-74e2-46e3-b994-24670fa8f58a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:39.914281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d3d6c-501f-427b-80da-93aec1c484b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:39.915187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d3d6c-501f-427b-80da-93aec1c484b5 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.915473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d3d6c-501f-427b-80da-93aec1c484b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.915744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d3d6c-501f-427b-80da-93aec1c484b5 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.920586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d3d6c-501f-427b-80da-93aec1c484b5 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:39.922523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d3d6c-501f-427b-80da-93aec1c484b5 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:39.925278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 124/247] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:39 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:39.932178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d3d6c-501f-427b-80da-93aec1c484b5 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:39.958516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e241ab2-4dad-4fcc-8b99-a7ddc2ef74f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:39.959246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e241ab2-4dad-4fcc-8b99-a7ddc2ef74f8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:39.959538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e241ab2-4dad-4fcc-8b99-a7ddc2ef74f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:39.959815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e241ab2-4dad-4fcc-8b99-a7ddc2ef74f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:39.971996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e241ab2-4dad-4fcc-8b99-a7ddc2ef74f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-3e241ab2-4dad-4fcc-8b99-a7ddc2ef74f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:39.979947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:39.980918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:39.981807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 124/248] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:39.987352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e241ab2-4dad-4fcc-8b99-a7ddc2ef74f8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:40.043531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d3d6c-501f-427b-80da-93aec1c484b5 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:40.078081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da11eb-54d4-4071-83ef-404544b630ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:40.078741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da11eb-54d4-4071-83ef-404544b630ac None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.079074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da11eb-54d4-4071-83ef-404544b630ac None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.079352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da11eb-54d4-4071-83ef-404544b630ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.080238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da11eb-54d4-4071-83ef-404544b630ac None admin] RBAC: Adding query filter params (role.id=d3c2851744d94b809dac16599fa42789, scope.project.id=6c9ffaa9059441daacf4f61653c20168, user.id=28bfe97c81904d7994481ac47b12207c) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:40.080550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da11eb-54d4-4071-83ef-404544b630ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:40.082014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da11eb-54d4-4071-83ef-404544b630ac None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:40.087731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 125/249] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:39 2022] GET /identity/v3/role_assignments?user.id=28bfe97c81904d7994481ac47b12207c&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=d3c2851744d94b809dac16599fa42789 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:40.090300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e241ab2-4dad-4fcc-8b99-a7ddc2ef74f8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:40.135918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb2662-4eb5-4d02-97d3-2b77250ddab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:40.136608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb2662-4eb5-4d02-97d3-2b77250ddab6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.136888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb2662-4eb5-4d02-97d3-2b77250ddab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.137156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb2662-4eb5-4d02-97d3-2b77250ddab6 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.137947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb2662-4eb5-4d02-97d3-2b77250ddab6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:40.138248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb2662-4eb5-4d02-97d3-2b77250ddab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:40.139644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb2662-4eb5-4d02-97d3-2b77250ddab6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:40.154802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 125/250] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:40.160360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da11eb-54d4-4071-83ef-404544b630ac None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:40.170727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19514b-5a49-4dc9-8f53-ac184fbe61cc None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.171022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19514b-5a49-4dc9-8f53-ac184fbe61cc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.171280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19514b-5a49-4dc9-8f53-ac184fbe61cc None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.173219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 126/251] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:40.180336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c23a93-86da-42da-8f70-c1dc8702a7f3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.180629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c23a93-86da-42da-8f70-c1dc8702a7f3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.180885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c23a93-86da-42da-8f70-c1dc8702a7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.207450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c9c23a93-86da-42da-8f70-c1dc8702a7f3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:40.208329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c9c23a93-86da-42da-8f70-c1dc8702a7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:40.285475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 127/252] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:40.301216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da11eb-54d4-4071-83ef-404544b630ac None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:40.309794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c23a93-86da-42da-8f70-c1dc8702a7f3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:40.347039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8d17-2014-4dbe-bdea-8d0de15ac912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:40.348216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8d17-2014-4dbe-bdea-8d0de15ac912 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.348658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8d17-2014-4dbe-bdea-8d0de15ac912 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.348933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8d17-2014-4dbe-bdea-8d0de15ac912 None admin] PATH_INFO: `/v3/users/36dea8131fe648039507a66f446798f5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.350177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d8d17-2014-4dbe-bdea-8d0de15ac912 None admin] RBAC: Authorizing `identity:get_user(user_id=36dea8131fe648039507a66f446798f5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:40.351643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d8d17-2014-4dbe-bdea-8d0de15ac912 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:40.353607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 126/253] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:40 2022] GET /identity/v3/users/36dea8131fe648039507a66f446798f5 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:40.359571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8d17-2014-4dbe-bdea-8d0de15ac912 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:40.434051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c23a93-86da-42da-8f70-c1dc8702a7f3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:40.470838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9d64a-845a-4927-8c4d-215262ce0061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:40.471647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9d64a-845a-4927-8c4d-215262ce0061 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.471932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9d64a-845a-4927-8c4d-215262ce0061 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.472210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9d64a-845a-4927-8c4d-215262ce0061 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.484090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9d64a-845a-4927-8c4d-215262ce0061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:40.486961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8d17-2014-4dbe-bdea-8d0de15ac912 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-fba9d64a-845a-4927-8c4d-215262ce0061 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:40.493082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:40.493983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:40.494777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 128/254] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:40.501129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9d64a-845a-4927-8c4d-215262ce0061 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:40.529295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271463-e05b-4194-8110-c9fffa585770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:40.530811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271463-e05b-4194-8110-c9fffa585770 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.531094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271463-e05b-4194-8110-c9fffa585770 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.531651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271463-e05b-4194-8110-c9fffa585770 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.533064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4271463-e05b-4194-8110-c9fffa585770 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:40.535195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4271463-e05b-4194-8110-c9fffa585770 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:40.537640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 127/255] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:40 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:40.543721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271463-e05b-4194-8110-c9fffa585770 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:40.618784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9d64a-845a-4927-8c4d-215262ce0061 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:40.652711 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6421-0e27-4438-becb-6cacf136c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:40.653383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6421-0e27-4438-becb-6cacf136c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.653701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6421-0e27-4438-becb-6cacf136c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.653979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6421-0e27-4438-becb-6cacf136c4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.654729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6421-0e27-4438-becb-6cacf136c4a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:40.655033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6421-0e27-4438-becb-6cacf136c4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:40.656420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6421-0e27-4438-becb-6cacf136c4a7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:40.664994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 129/256] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:40.665223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271463-e05b-4194-8110-c9fffa585770 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:40.670969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6421-0e27-4438-becb-6cacf136c4a7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:40.700364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3193db6-993d-4c44-8cf4-1742954c915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:40.701246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3193db6-993d-4c44-8cf4-1742954c915d None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.701594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3193db6-993d-4c44-8cf4-1742954c915d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.701927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3193db6-993d-4c44-8cf4-1742954c915d None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168/users/36dea8131fe648039507a66f446798f5/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.705042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3193db6-993d-4c44-8cf4-1742954c915d None admin] RBAC: Authorizing `identity:create_grant(project_id=6c9ffaa9059441daacf4f61653c20168, user_id=36dea8131fe648039507a66f446798f5, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:40.706611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3193db6-993d-4c44-8cf4-1742954c915d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:40.721203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 128/257] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:45:40 2022] PUT /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168/users/36dea8131fe648039507a66f446798f5/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:45:40.786867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6421-0e27-4438-becb-6cacf136c4a7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:40.827495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0028a91-b409-4f7e-a43a-50514999c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:40.828318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028a91-b409-4f7e-a43a-50514999c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.828657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028a91-b409-4f7e-a43a-50514999c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.828992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028a91-b409-4f7e-a43a-50514999c3c2 None admin] PATH_INFO: `/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:40.830385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0028a91-b409-4f7e-a43a-50514999c3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=48cb3953f24d4e91bc3629ecd9dc8ac5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:40.831873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0028a91-b409-4f7e-a43a-50514999c3c2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:40.833902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 130/258] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:40 2022] GET /identity/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:40.839956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3193db6-993d-4c44-8cf4-1742954c915d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:40.951881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3193db6-993d-4c44-8cf4-1742954c915d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:40.986636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66a41a-aaf1-4b12-b02c-9619bef1ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:40.987340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66a41a-aaf1-4b12-b02c-9619bef1ecbe None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:40.987625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66a41a-aaf1-4b12-b02c-9619bef1ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:40.987924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66a41a-aaf1-4b12-b02c-9619bef1ecbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:41.066841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66a41a-aaf1-4b12-b02c-9619bef1ecbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:41.068310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66a41a-aaf1-4b12-b02c-9619bef1ecbe None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:41.172075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 129/259] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:45:41.175020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0028a91-b409-4f7e-a43a-50514999c3c2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:41.188666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b5e39-8863-47b3-aceb-6a4842c59959 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:41.189185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b5e39-8863-47b3-aceb-6a4842c59959 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:41.189709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b5e39-8863-47b3-aceb-6a4842c59959 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:41.191343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 130/260] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:41.197313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16ae4-5b4f-4f4d-92c5-1bfaf72633ed None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:41.197637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16ae4-5b4f-4f4d-92c5-1bfaf72633ed None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:41.197920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16ae4-5b4f-4f4d-92c5-1bfaf72633ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:41.242718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-aae16ae4-5b4f-4f4d-92c5-1bfaf72633ed None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:41.243734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-aae16ae4-5b4f-4f4d-92c5-1bfaf72633ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:41.324344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0028a91-b409-4f7e-a43a-50514999c3c2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:41.361234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67760c0-0c0d-46da-ab14-3f560bbbdea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:41.362404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67760c0-0c0d-46da-ab14-3f560bbbdea6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:41.362836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67760c0-0c0d-46da-ab14-3f560bbbdea6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:41.363254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67760c0-0c0d-46da-ab14-3f560bbbdea6 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:41.365123 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67760c0-0c0d-46da-ab14-3f560bbbdea6 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:41.366789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67760c0-0c0d-46da-ab14-3f560bbbdea6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:41.368941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 131/261] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:41 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:41.378499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67760c0-0c0d-46da-ab14-3f560bbbdea6 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:41.399571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 131/262] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:41.422504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae16ae4-5b4f-4f4d-92c5-1bfaf72633ed None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:41.530539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae16ae4-5b4f-4f4d-92c5-1bfaf72633ed None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:41.565989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba49c4-b540-4651-b3b9-bf5267c19644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:41.566800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba49c4-b540-4651-b3b9-bf5267c19644 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:41.567081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba49c4-b540-4651-b3b9-bf5267c19644 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:41.567351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba49c4-b540-4651-b3b9-bf5267c19644 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:41.578532 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba49c4-b540-4651-b3b9-bf5267c19644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-05ba49c4-b540-4651-b3b9-bf5267c19644 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:41.586673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:41.587593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:41.588417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 132/263] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:45:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:41.593476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba49c4-b540-4651-b3b9-bf5267c19644 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:41.625069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67760c0-0c0d-46da-ab14-3f560bbbdea6 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:41.690645 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fba6cc-00aa-4f51-be97-0fcc0b0bfc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:41.691316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba6cc-00aa-4f51-be97-0fcc0b0bfc27 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:41.691600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba6cc-00aa-4f51-be97-0fcc0b0bfc27 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:41.691877 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba6cc-00aa-4f51-be97-0fcc0b0bfc27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:41.692720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fba6cc-00aa-4f51-be97-0fcc0b0bfc27 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=6c9ffaa9059441daacf4f61653c20168, user.id=48cb3953f24d4e91bc3629ecd9dc8ac5) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:41.693031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fba6cc-00aa-4f51-be97-0fcc0b0bfc27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:41.694499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fba6cc-00aa-4f51-be97-0fcc0b0bfc27 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:41.713660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 132/264] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:41 2022] GET /identity/v3/role_assignments?user.id=48cb3953f24d4e91bc3629ecd9dc8ac5&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=d03e020b3fb34446bbf5893b28904483 => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:41.763467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba49c4-b540-4651-b3b9-bf5267c19644 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:41.799440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fab1bb-efe7-4372-875e-160131115bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:41.800111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab1bb-efe7-4372-875e-160131115bae None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:41.800394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab1bb-efe7-4372-875e-160131115bae None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:41.800666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab1bb-efe7-4372-875e-160131115bae None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:41.801411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fab1bb-efe7-4372-875e-160131115bae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:41.801745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fab1bb-efe7-4372-875e-160131115bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:41.803364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fab1bb-efe7-4372-875e-160131115bae None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:41.813512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 133/265] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:45:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:41.818641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fba6cc-00aa-4f51-be97-0fcc0b0bfc27 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:41.927849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fba6cc-00aa-4f51-be97-0fcc0b0bfc27 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:41.969438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab3bf3-cf96-48f1-825c-4bbdbabfd9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:41.970330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab3bf3-cf96-48f1-825c-4bbdbabfd9a1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:41.970616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab3bf3-cf96-48f1-825c-4bbdbabfd9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:41.970891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab3bf3-cf96-48f1-825c-4bbdbabfd9a1 None admin] PATH_INFO: `/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:41.974599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab3bf3-cf96-48f1-825c-4bbdbabfd9a1 None admin] RBAC: Authorizing `identity:get_user(user_id=48cb3953f24d4e91bc3629ecd9dc8ac5)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:41.976075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab3bf3-cf96-48f1-825c-4bbdbabfd9a1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:41.978172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 133/266] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:41 2022] GET /identity/v3/users/48cb3953f24d4e91bc3629ecd9dc8ac5 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:41.984010 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fab1bb-efe7-4372-875e-160131115bae None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:42.084130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fab1bb-efe7-4372-875e-160131115bae None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:42.119141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff59de1-a132-42a9-98d5-0bbf86b10628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:42.119821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff59de1-a132-42a9-98d5-0bbf86b10628 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:42.120138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff59de1-a132-42a9-98d5-0bbf86b10628 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:42.120412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff59de1-a132-42a9-98d5-0bbf86b10628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:42.193652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff59de1-a132-42a9-98d5-0bbf86b10628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:42.195118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff59de1-a132-42a9-98d5-0bbf86b10628 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:42.295211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 134/267] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:42.300554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab3bf3-cf96-48f1-825c-4bbdbabfd9a1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:42.406223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab3bf3-cf96-48f1-825c-4bbdbabfd9a1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:42.439803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b02461-5314-4206-8ee5-415df76b1251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:42.440677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b02461-5314-4206-8ee5-415df76b1251 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:42.440957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b02461-5314-4206-8ee5-415df76b1251 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:42.441229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b02461-5314-4206-8ee5-415df76b1251 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:42.442438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b02461-5314-4206-8ee5-415df76b1251 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:42.443974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b02461-5314-4206-8ee5-415df76b1251 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:42.446056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 134/268] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:42 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:42.454617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff59de1-a132-42a9-98d5-0bbf86b10628 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:42.576721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff59de1-a132-42a9-98d5-0bbf86b10628 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:42.614901 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dab382-b94c-45fd-8176-41cdcde2ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:42.615555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab382-b94c-45fd-8176-41cdcde2ba8e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:42.615836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab382-b94c-45fd-8176-41cdcde2ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:42.616111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab382-b94c-45fd-8176-41cdcde2ba8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:42.616942 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dab382-b94c-45fd-8176-41cdcde2ba8e None admin] RBAC: Adding query filter params (role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=6c9ffaa9059441daacf4f61653c20168, user.id=48cb3953f24d4e91bc3629ecd9dc8ac5) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:42.617256 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dab382-b94c-45fd-8176-41cdcde2ba8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:42.618831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dab382-b94c-45fd-8176-41cdcde2ba8e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:42.624942 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 135/269] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:42 2022] GET /identity/v3/role_assignments?user.id=48cb3953f24d4e91bc3629ecd9dc8ac5&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:43.345423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73039564-f3ba-453f-b307-d8a04dd3832c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.346288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73039564-f3ba-453f-b307-d8a04dd3832c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.346734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73039564-f3ba-453f-b307-d8a04dd3832c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.348264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 135/270] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:43.354163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69abe51-7654-4dc9-9c98-173145aec3de None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.355713 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69abe51-7654-4dc9-9c98-173145aec3de None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.356185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69abe51-7654-4dc9-9c98-173145aec3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.377041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b69abe51-7654-4dc9-9c98-173145aec3de None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:43.378568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b69abe51-7654-4dc9-9c98-173145aec3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:43.462299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 136/271] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:43.481272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911b82e-6a7e-4a6b-af4d-6a337e5e3995 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.481599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911b82e-6a7e-4a6b-af4d-6a337e5e3995 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.481885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911b82e-6a7e-4a6b-af4d-6a337e5e3995 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.483516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 136/272] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:43.487245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69abe51-7654-4dc9-9c98-173145aec3de None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:43.489647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c4f68-e8b0-4dc6-b5ac-bc0e3c6e949a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.489939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c4f68-e8b0-4dc6-b5ac-bc0e3c6e949a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.490989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c4f68-e8b0-4dc6-b5ac-bc0e3c6e949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.507056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-003c4f68-e8b0-4dc6-b5ac-bc0e3c6e949a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:43.508255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-003c4f68-e8b0-4dc6-b5ac-bc0e3c6e949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:43.577966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 137/273] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:43.588142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69abe51-7654-4dc9-9c98-173145aec3de None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:43.602045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c4f68-e8b0-4dc6-b5ac-bc0e3c6e949a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:43.623149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755220a5-16e0-4c0e-a6c2-2aea21c2706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:43.623940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755220a5-16e0-4c0e-a6c2-2aea21c2706f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.624216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755220a5-16e0-4c0e-a6c2-2aea21c2706f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.624490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755220a5-16e0-4c0e-a6c2-2aea21c2706f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.625688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755220a5-16e0-4c0e-a6c2-2aea21c2706f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:43.627188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755220a5-16e0-4c0e-a6c2-2aea21c2706f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:43.628811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 137/274] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:43.630101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1913-7d8f-4c45-83e2-90a169bb9a01 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.630382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1913-7d8f-4c45-83e2-90a169bb9a01 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.630658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1913-7d8f-4c45-83e2-90a169bb9a01 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.631923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 138/275] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:43.633199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab7f7-ed4a-4151-9383-532b8a83101c None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.633301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab7f7-ed4a-4151-9383-532b8a83101c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.633604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab7f7-ed4a-4151-9383-532b8a83101c None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.634997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 139/276] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:43.635642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab7f7-ed4a-4151-9383-532b8a83101c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:43.698118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c4f68-e8b0-4dc6-b5ac-bc0e3c6e949a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:43.730758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d43706-c193-4f0c-a90d-6737ed7968de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:43.731546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d43706-c193-4f0c-a90d-6737ed7968de None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.731653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab7f7-ed4a-4151-9383-532b8a83101c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:43.731831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d43706-c193-4f0c-a90d-6737ed7968de None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.732101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d43706-c193-4f0c-a90d-6737ed7968de None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.741735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d43706-c193-4f0c-a90d-6737ed7968de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-96d43706-c193-4f0c-a90d-6737ed7968de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:43.749354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:43.750251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:43.751040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 138/277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:43.751712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe817fc-6538-44bb-9bf1-99e252ea3537 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.751963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe817fc-6538-44bb-9bf1-99e252ea3537 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.752238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe817fc-6538-44bb-9bf1-99e252ea3537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.767564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c118e3-85e4-4bf7-93af-92eff41e148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:43.767943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1fe817fc-6538-44bb-9bf1-99e252ea3537 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:43.768219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c118e3-85e4-4bf7-93af-92eff41e148a None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.768500 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c118e3-85e4-4bf7-93af-92eff41e148a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.768773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c118e3-85e4-4bf7-93af-92eff41e148a None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.769115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1fe817fc-6538-44bb-9bf1-99e252ea3537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:43.769468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c118e3-85e4-4bf7-93af-92eff41e148a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:43.770938 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c118e3-85e4-4bf7-93af-92eff41e148a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:43.789689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 140/278] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:45:43 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:45:43.790960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b708a-9e7c-4f5f-a664-66463935226c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:43.791253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b708a-9e7c-4f5f-a664-66463935226c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:43.791530 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b708a-9e7c-4f5f-a664-66463935226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:43.810939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-373b708a-9e7c-4f5f-a664-66463935226c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:43.812588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-373b708a-9e7c-4f5f-a664-66463935226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:43.837633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 139/279] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:43.842563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe817fc-6538-44bb-9bf1-99e252ea3537 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:43.903188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 141/280] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:43.906880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b708a-9e7c-4f5f-a664-66463935226c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:43.961780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe817fc-6538-44bb-9bf1-99e252ea3537 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.000793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98ddf4-3491-4bda-b5b8-0a4e5fc157a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.001474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98ddf4-3491-4bda-b5b8-0a4e5fc157a3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.001805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98ddf4-3491-4bda-b5b8-0a4e5fc157a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.002083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98ddf4-3491-4bda-b5b8-0a4e5fc157a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.002847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98ddf4-3491-4bda-b5b8-0a4e5fc157a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:44.003159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98ddf4-3491-4bda-b5b8-0a4e5fc157a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:44.004550 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98ddf4-3491-4bda-b5b8-0a4e5fc157a3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:44.014475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 140/281] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:44.015386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98ddf4-3491-4bda-b5b8-0a4e5fc157a3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.021003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b708a-9e7c-4f5f-a664-66463935226c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.066780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e6ce-ac58-4dde-9409-3b03869298d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.067586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e6ce-ac58-4dde-9409-3b03869298d0 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.067859 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e6ce-ac58-4dde-9409-3b03869298d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.068141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e6ce-ac58-4dde-9409-3b03869298d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.082359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760e6ce-ac58-4dde-9409-3b03869298d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-6760e6ce-ac58-4dde-9409-3b03869298d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:44.091799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:44.092715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:44.093509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 142/282] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:44.094269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e6ce-ac58-4dde-9409-3b03869298d0 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.132804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98ddf4-3491-4bda-b5b8-0a4e5fc157a3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.177407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab24c8-0ffd-4e45-a98e-9e6fc07f750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.178757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab24c8-0ffd-4e45-a98e-9e6fc07f750c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.179308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab24c8-0ffd-4e45-a98e-9e6fc07f750c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.179648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab24c8-0ffd-4e45-a98e-9e6fc07f750c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.197124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab24c8-0ffd-4e45-a98e-9e6fc07f750c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-38ab24c8-0ffd-4e45-a98e-9e6fc07f750c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:44.208034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:44.208931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:44.209765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:44.210383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 141/283] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:44.215410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab24c8-0ffd-4e45-a98e-9e6fc07f750c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.215560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e6ce-ac58-4dde-9409-3b03869298d0 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.254898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d6a8-2f50-4edf-8d68-88c0032a95b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.256961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d6a8-2f50-4edf-8d68-88c0032a95b6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.257244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d6a8-2f50-4edf-8d68-88c0032a95b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.257516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d6a8-2f50-4edf-8d68-88c0032a95b6 None admin] PATH_INFO: `/v3/users/36dea8131fe648039507a66f446798f5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.258810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d6a8-2f50-4edf-8d68-88c0032a95b6 None admin] RBAC: Authorizing `identity:get_user(user_id=36dea8131fe648039507a66f446798f5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:44.260253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d6a8-2f50-4edf-8d68-88c0032a95b6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:44.263296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 143/284] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/users/36dea8131fe648039507a66f446798f5 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:44.264485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d6a8-2f50-4edf-8d68-88c0032a95b6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.333745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab24c8-0ffd-4e45-a98e-9e6fc07f750c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.376419 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e60fc-166b-44ce-96f2-d14d8af0fda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.377182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d6a8-2f50-4edf-8d68-88c0032a95b6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.377660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e60fc-166b-44ce-96f2-d14d8af0fda8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.377660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e60fc-166b-44ce-96f2-d14d8af0fda8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.377660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e60fc-166b-44ce-96f2-d14d8af0fda8 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.381551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e60fc-166b-44ce-96f2-d14d8af0fda8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:44.381551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e60fc-166b-44ce-96f2-d14d8af0fda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:44.381551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e60fc-166b-44ce-96f2-d14d8af0fda8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:44.392102 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 142/285] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:44.393066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e60fc-166b-44ce-96f2-d14d8af0fda8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.415361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeaf7f-1768-4b7c-85cc-1c91f879cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.416034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeaf7f-1768-4b7c-85cc-1c91f879cb51 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.416317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeaf7f-1768-4b7c-85cc-1c91f879cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.416637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeaf7f-1768-4b7c-85cc-1c91f879cb51 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.417428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaeaf7f-1768-4b7c-85cc-1c91f879cb51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:44.417787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaeaf7f-1768-4b7c-85cc-1c91f879cb51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:44.419225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaeaf7f-1768-4b7c-85cc-1c91f879cb51 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:44.428224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 144/286] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:44.429083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeaf7f-1768-4b7c-85cc-1c91f879cb51 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.492547 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e60fc-166b-44ce-96f2-d14d8af0fda8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.527779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb348-55b9-4664-9299-457dd0e3bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.528438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb348-55b9-4664-9299-457dd0e3bda9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.528720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb348-55b9-4664-9299-457dd0e3bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.528998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb348-55b9-4664-9299-457dd0e3bda9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.544660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeaf7f-1768-4b7c-85cc-1c91f879cb51 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.590524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666194-27b6-4723-a782-365f9edf16c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.591854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666194-27b6-4723-a782-365f9edf16c1 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.592135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666194-27b6-4723-a782-365f9edf16c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.592683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666194-27b6-4723-a782-365f9edf16c1 None admin] PATH_INFO: `/v3/users/30a8c88918804021a1858e1fa7d2ad7c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.601020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cb348-55b9-4664-9299-457dd0e3bda9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:44.602708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cb348-55b9-4664-9299-457dd0e3bda9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:44.610123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df666194-27b6-4723-a782-365f9edf16c1 None admin] RBAC: Authorizing `identity:get_user(user_id=30a8c88918804021a1858e1fa7d2ad7c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:44.612002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df666194-27b6-4723-a782-365f9edf16c1 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:44.614096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 145/287] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/users/30a8c88918804021a1858e1fa7d2ad7c => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:44.615291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666194-27b6-4723-a782-365f9edf16c1 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.723050 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666194-27b6-4723-a782-365f9edf16c1 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.723939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 143/288] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:44.724901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb348-55b9-4664-9299-457dd0e3bda9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.765120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892179-c49a-4592-9303-0a6c550b6624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.766376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892179-c49a-4592-9303-0a6c550b6624 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.766661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892179-c49a-4592-9303-0a6c550b6624 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.766932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892179-c49a-4592-9303-0a6c550b6624 None admin] PATH_INFO: `/v3/users/28bfe97c81904d7994481ac47b12207c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.768714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66892179-c49a-4592-9303-0a6c550b6624 None admin] RBAC: Authorizing `identity:get_user(user_id=28bfe97c81904d7994481ac47b12207c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:44.770364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66892179-c49a-4592-9303-0a6c550b6624 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:44.772641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 146/289] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/users/28bfe97c81904d7994481ac47b12207c => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:44.773563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892179-c49a-4592-9303-0a6c550b6624 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.827701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb348-55b9-4664-9299-457dd0e3bda9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.871311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120a601-7b23-4c18-8636-98045a874121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.871971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120a601-7b23-4c18-8636-98045a874121 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.872249 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120a601-7b23-4c18-8636-98045a874121 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.872656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120a601-7b23-4c18-8636-98045a874121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.873885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120a601-7b23-4c18-8636-98045a874121 None admin] RBAC: Adding query filter params (role.id=4a765555b657413ea79721175a7191e3, user.id=30a8c88918804021a1858e1fa7d2ad7c, scope.system=all) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:44.874198 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120a601-7b23-4c18-8636-98045a874121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:44.876121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120a601-7b23-4c18-8636-98045a874121 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:44.881605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892179-c49a-4592-9303-0a6c550b6624 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:44.882531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 144/290] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/role_assignments?user.id=30a8c88918804021a1858e1fa7d2ad7c&scope.system=all&role.id=4a765555b657413ea79721175a7191e3 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:44.883106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120a601-7b23-4c18-8636-98045a874121 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:44.920099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf1883-0be5-4f3e-b638-a097e1fe61e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:44.921240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf1883-0be5-4f3e-b638-a097e1fe61e6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:44.921718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf1883-0be5-4f3e-b638-a097e1fe61e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:44.922353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf1883-0be5-4f3e-b638-a097e1fe61e6 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:44.923752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf1883-0be5-4f3e-b638-a097e1fe61e6 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:44.925389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf1883-0be5-4f3e-b638-a097e1fe61e6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:44.927323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 147/291] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:44.933862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf1883-0be5-4f3e-b638-a097e1fe61e6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:45.017310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120a601-7b23-4c18-8636-98045a874121 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:45.036691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf1883-0be5-4f3e-b638-a097e1fe61e6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:45.065150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeb76c-f1dc-4405-9569-2e5da26da704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:45.066151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb76c-f1dc-4405-9569-2e5da26da704 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:45.067996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb76c-f1dc-4405-9569-2e5da26da704 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:45.069656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb76c-f1dc-4405-9569-2e5da26da704 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:45.071721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aeb76c-f1dc-4405-9569-2e5da26da704 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:45.073229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aeb76c-f1dc-4405-9569-2e5da26da704 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:45.080644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 145/292] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:45.085276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeb76c-f1dc-4405-9569-2e5da26da704 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:45.091138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20d876-b3e5-4222-9144-06e395fbcb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:45.091904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d876-b3e5-4222-9144-06e395fbcb0c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:45.092184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d876-b3e5-4222-9144-06e395fbcb0c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:45.094659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d876-b3e5-4222-9144-06e395fbcb0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:45.096315 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20d876-b3e5-4222-9144-06e395fbcb0c None admin] RBAC: Adding query filter params (role.id=4a765555b657413ea79721175a7191e3, scope.project.id=6c9ffaa9059441daacf4f61653c20168, user.id=36dea8131fe648039507a66f446798f5) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:45.096883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20d876-b3e5-4222-9144-06e395fbcb0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:45.098483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20d876-b3e5-4222-9144-06e395fbcb0c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:45.115521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 148/293] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:44 2022] GET /identity/v3/role_assignments?user.id=36dea8131fe648039507a66f446798f5&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=4a765555b657413ea79721175a7191e3 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:45.227984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeb76c-f1dc-4405-9569-2e5da26da704 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:45.266191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f7f4-2414-47d4-9b79-68b7b3991a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:45.267104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f7f4-2414-47d4-9b79-68b7b3991a31 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:45.267440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f7f4-2414-47d4-9b79-68b7b3991a31 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:45.267662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f7f4-2414-47d4-9b79-68b7b3991a31 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168/users/28bfe97c81904d7994481ac47b12207c/roles/d3c2851744d94b809dac16599fa42789` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:45.269776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707f7f4-2414-47d4-9b79-68b7b3991a31 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c9ffaa9059441daacf4f61653c20168, user_id=28bfe97c81904d7994481ac47b12207c, role_id=d3c2851744d94b809dac16599fa42789)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:45.271259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707f7f4-2414-47d4-9b79-68b7b3991a31 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:45.291650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 146/294] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:45:45 2022] PUT /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168/users/28bfe97c81904d7994481ac47b12207c/roles/d3c2851744d94b809dac16599fa42789 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:46.279735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724d541-ec21-4355-8a86-b01b3ff8425b None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:46.280266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724d541-ec21-4355-8a86-b01b3ff8425b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:46.280266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724d541-ec21-4355-8a86-b01b3ff8425b None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:46.282043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 149/295] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:46.289577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7af25-2282-4c4a-a020-47582fba64f6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:46.289577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7af25-2282-4c4a-a020-47582fba64f6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:46.289577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7af25-2282-4c4a-a020-47582fba64f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:46.306643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-aad7af25-2282-4c4a-a020-47582fba64f6 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:46.308559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-aad7af25-2282-4c4a-a020-47582fba64f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:46.380841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 147/296] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:46.401807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724d541-ec21-4355-8a86-b01b3ff8425b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:46.506514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724d541-ec21-4355-8a86-b01b3ff8425b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:46.542722 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64aaec-b005-433b-9523-1f4e0386fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:46.543715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64aaec-b005-433b-9523-1f4e0386fc56 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:46.544298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64aaec-b005-433b-9523-1f4e0386fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:46.544792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64aaec-b005-433b-9523-1f4e0386fc56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:46.556744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c030e-6ca2-4cd8-9aec-4b3b371eab2a None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:46.556744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c030e-6ca2-4cd8-9aec-4b3b371eab2a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:46.556744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c030e-6ca2-4cd8-9aec-4b3b371eab2a None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:46.557969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64aaec-b005-433b-9523-1f4e0386fc56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:46.558400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 148/297] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-0a64aaec-b005-433b-9523-1f4e0386fc56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:46.570188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:46.571167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:46.571966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:46.572577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963206-1d58-457d-b9e7-4c04a81331ef None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:46.572577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963206-1d58-457d-b9e7-4c04a81331ef None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:46.572577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963206-1d58-457d-b9e7-4c04a81331ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:46.575259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 150/298] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:46.582980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64aaec-b005-433b-9523-1f4e0386fc56 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:46.616149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ae963206-1d58-457d-b9e7-4c04a81331ef None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:46.617349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ae963206-1d58-457d-b9e7-4c04a81331ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:46.718197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64aaec-b005-433b-9523-1f4e0386fc56 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:46.756629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab3f0-de41-40ae-a747-d5bc053b3a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:46.758023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab3f0-de41-40ae-a747-d5bc053b3a65 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:46.758690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab3f0-de41-40ae-a747-d5bc053b3a65 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:46.759165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab3f0-de41-40ae-a747-d5bc053b3a65 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:46.760115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ab3f0-de41-40ae-a747-d5bc053b3a65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:46.761182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ab3f0-de41-40ae-a747-d5bc053b3a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:46.763613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ab3f0-de41-40ae-a747-d5bc053b3a65 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:46.779977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 151/299] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:46.780784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 149/300] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:46.781670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab3f0-de41-40ae-a747-d5bc053b3a65 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:46.830869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae963206-1d58-457d-b9e7-4c04a81331ef None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:46.916495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab3f0-de41-40ae-a747-d5bc053b3a65 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:46.941609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae963206-1d58-457d-b9e7-4c04a81331ef None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:46.965023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7f76b-0ba1-4237-8b36-1a27e72264ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:46.966512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7f76b-0ba1-4237-8b36-1a27e72264ac None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:46.966920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7f76b-0ba1-4237-8b36-1a27e72264ac None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:46.967266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7f76b-0ba1-4237-8b36-1a27e72264ac None admin] PATH_INFO: `/v3/users/f970ee85d064401e91488f8512764d93` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:46.980201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62136b-524f-4525-a8b4-adfcb423dc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:46.981442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62136b-524f-4525-a8b4-adfcb423dc1e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:46.981834 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7f76b-0ba1-4237-8b36-1a27e72264ac None admin] RBAC: Authorizing `identity:get_user(user_id=f970ee85d064401e91488f8512764d93)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:46.982104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62136b-524f-4525-a8b4-adfcb423dc1e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:46.982604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62136b-524f-4525-a8b4-adfcb423dc1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:46.983604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7f76b-0ba1-4237-8b36-1a27e72264ac None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:46.984087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62136b-524f-4525-a8b4-adfcb423dc1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:46.985505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 152/301] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:46 2022] GET /identity/v3/users/f970ee85d064401e91488f8512764d93 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:46.985889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62136b-524f-4525-a8b4-adfcb423dc1e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:46.987929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 150/302] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:46.994240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7f76b-0ba1-4237-8b36-1a27e72264ac None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:46.994539 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62136b-524f-4525-a8b4-adfcb423dc1e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:47.098209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62136b-524f-4525-a8b4-adfcb423dc1e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:47.098589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7f76b-0ba1-4237-8b36-1a27e72264ac None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:47.136278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ec038-f17c-4f3f-81c4-8a7b574f5e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:47.137075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec038-f17c-4f3f-81c4-8a7b574f5e84 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:47.137418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec038-f17c-4f3f-81c4-8a7b574f5e84 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:47.137799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec038-f17c-4f3f-81c4-8a7b574f5e84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:47.138736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec038-f17c-4f3f-81c4-8a7b574f5e84 None admin] RBAC: Adding query filter params (role.id=d3c2851744d94b809dac16599fa42789, user.id=f970ee85d064401e91488f8512764d93, scope.system=all) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:47.139099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec038-f17c-4f3f-81c4-8a7b574f5e84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:47.140622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec038-f17c-4f3f-81c4-8a7b574f5e84 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:47.141343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078d90c-881c-4f0a-bce1-8f304dda2a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:47.142225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078d90c-881c-4f0a-bce1-8f304dda2a4f None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:47.142693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078d90c-881c-4f0a-bce1-8f304dda2a4f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:47.143138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078d90c-881c-4f0a-bce1-8f304dda2a4f None admin] PATH_INFO: `/v3/groups` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:47.144019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078d90c-881c-4f0a-bce1-8f304dda2a4f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:47.145639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078d90c-881c-4f0a-bce1-8f304dda2a4f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:47.152353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 151/303] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 12 18:45:46 2022] GET /identity/v3/role_assignments?user.id=f970ee85d064401e91488f8512764d93&scope.system=all&role.id=d3c2851744d94b809dac16599fa42789 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:47.164396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 153/304] 10.222.0.48 () {60 vars in 1134 bytes} [Thu May 12 18:45:46 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:45:47.507631 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48631cb-2987-440b-bda9-d0241538e5c5 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:47.508169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48631cb-2987-440b-bda9-d0241538e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:47.508169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48631cb-2987-440b-bda9-d0241538e5c5 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:47.511533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 152/305] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:47.517895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdac22-c2e6-407e-9ed0-539ceb24420c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:47.518383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdac22-c2e6-407e-9ed0-539ceb24420c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:47.518458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdac22-c2e6-407e-9ed0-539ceb24420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:47.536325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-8fbdac22-c2e6-407e-9ed0-539ceb24420c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:47.537832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8fbdac22-c2e6-407e-9ed0-539ceb24420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:47.618945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 154/306] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:47.641715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48631cb-2987-440b-bda9-d0241538e5c5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:47.743554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48631cb-2987-440b-bda9-d0241538e5c5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:47.761766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e1dc6-ff2c-4e82-a892-7f98933cdda0 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:47.762039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e1dc6-ff2c-4e82-a892-7f98933cdda0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:47.762240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e1dc6-ff2c-4e82-a892-7f98933cdda0 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:47.763754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 155/307] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:47.768908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4ac9-9482-4480-ad86-9172fdf01fc0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:47.769192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4ac9-9482-4480-ad86-9172fdf01fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:47.769469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4ac9-9482-4480-ad86-9172fdf01fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:47.779503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e143ceb-1d6f-41a7-b465-cfc9dccdae1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:47.780298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e143ceb-1d6f-41a7-b465-cfc9dccdae1b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:47.780578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e143ceb-1d6f-41a7-b465-cfc9dccdae1b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:47.780851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e143ceb-1d6f-41a7-b465-cfc9dccdae1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:47.789247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-05ab4ac9-9482-4480-ad86-9172fdf01fc0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:47.790757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-05ab4ac9-9482-4480-ad86-9172fdf01fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:47.790884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e143ceb-1d6f-41a7-b465-cfc9dccdae1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-8e143ceb-1d6f-41a7-b465-cfc9dccdae1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:47.798804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:47.799713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:47.800506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 153/308] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:47.806475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e143ceb-1d6f-41a7-b465-cfc9dccdae1b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:47.882649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 156/309] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:47.906144 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4ac9-9482-4480-ad86-9172fdf01fc0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:47.912383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e143ceb-1d6f-41a7-b465-cfc9dccdae1b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:47.947589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5b562-4547-4541-ad88-84244c07be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:47.948862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5b562-4547-4541-ad88-84244c07be87 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:47.949141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5b562-4547-4541-ad88-84244c07be87 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:47.949410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5b562-4547-4541-ad88-84244c07be87 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:47.950190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5b562-4547-4541-ad88-84244c07be87 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:47.950492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5b562-4547-4541-ad88-84244c07be87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:47.951958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5b562-4547-4541-ad88-84244c07be87 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:47.960336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 154/310] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:47.966139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5b562-4547-4541-ad88-84244c07be87 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:48.030402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4ac9-9482-4480-ad86-9172fdf01fc0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:48.064736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125093-05b0-461b-8ce8-aa4ddd24397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:48.065724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125093-05b0-461b-8ce8-aa4ddd24397b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:48.066118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125093-05b0-461b-8ce8-aa4ddd24397b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:48.066487 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125093-05b0-461b-8ce8-aa4ddd24397b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:48.077136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b125093-05b0-461b-8ce8-aa4ddd24397b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:48.079227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5b562-4547-4541-ad88-84244c07be87 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-3b125093-05b0-461b-8ce8-aa4ddd24397b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:48.085193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:48.086892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:48.088776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:48.098040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 157/311] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:48.098040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125093-05b0-461b-8ce8-aa4ddd24397b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:48.118257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927343b1-2c3d-4348-8d25-92e845bab040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:48.119408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927343b1-2c3d-4348-8d25-92e845bab040 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:48.119690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927343b1-2c3d-4348-8d25-92e845bab040 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:48.120499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927343b1-2c3d-4348-8d25-92e845bab040 None admin] PATH_INFO: `/v3/users/30a8c88918804021a1858e1fa7d2ad7c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:48.122210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927343b1-2c3d-4348-8d25-92e845bab040 None admin] RBAC: Authorizing `identity:get_user(user_id=30a8c88918804021a1858e1fa7d2ad7c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:48.124108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927343b1-2c3d-4348-8d25-92e845bab040 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:48.126733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 155/312] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:47 2022] GET /identity/v3/users/30a8c88918804021a1858e1fa7d2ad7c => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:48.132140 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927343b1-2c3d-4348-8d25-92e845bab040 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:48.218243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125093-05b0-461b-8ce8-aa4ddd24397b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:48.241179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927343b1-2c3d-4348-8d25-92e845bab040 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:48.250463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d38be-40d4-4c12-b933-3dedff371736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:48.251226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d38be-40d4-4c12-b933-3dedff371736 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:48.251573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d38be-40d4-4c12-b933-3dedff371736 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:48.251914 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d38be-40d4-4c12-b933-3dedff371736 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:48.252834 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d38be-40d4-4c12-b933-3dedff371736 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:48.253204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d38be-40d4-4c12-b933-3dedff371736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:48.254687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d38be-40d4-4c12-b933-3dedff371736 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:48.267817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 158/313] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:48.268761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d38be-40d4-4c12-b933-3dedff371736 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:48.283893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4c8e-591f-44ab-8beb-162669f3333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:48.285497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4c8e-591f-44ab-8beb-162669f3333b None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:48.286015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4c8e-591f-44ab-8beb-162669f3333b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:48.286719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4c8e-591f-44ab-8beb-162669f3333b None admin] PATH_INFO: `/v3/system/users/30a8c88918804021a1858e1fa7d2ad7c/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:48.288809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d4c8e-591f-44ab-8beb-162669f3333b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=30a8c88918804021a1858e1fa7d2ad7c, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:48.290396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d4c8e-591f-44ab-8beb-162669f3333b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:48.304637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 156/314] 10.222.0.48 () {58 vars in 1334 bytes} [Thu May 12 18:45:48 2022] PUT /identity/v3/system/users/30a8c88918804021a1858e1fa7d2ad7c/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:45:48.393636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d38be-40d4-4c12-b933-3dedff371736 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:48.433740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84767b-1abb-4b08-a471-dc266544fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:48.435037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84767b-1abb-4b08-a471-dc266544fc24 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:48.435551 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84767b-1abb-4b08-a471-dc266544fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:48.436037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84767b-1abb-4b08-a471-dc266544fc24 None admin] PATH_INFO: `/v3/users/28bfe97c81904d7994481ac47b12207c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:48.437591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84767b-1abb-4b08-a471-dc266544fc24 None admin] RBAC: Authorizing `identity:get_user(user_id=28bfe97c81904d7994481ac47b12207c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:48.439309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84767b-1abb-4b08-a471-dc266544fc24 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:48.441708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 159/315] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:48 2022] GET /identity/v3/users/28bfe97c81904d7994481ac47b12207c => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:48.450733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4c8e-591f-44ab-8beb-162669f3333b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:48.554152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4c8e-591f-44ab-8beb-162669f3333b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:48.587749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f1b5-c3cc-4906-a37f-e2d3f8a7ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:48.588405 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f1b5-c3cc-4906-a37f-e2d3f8a7ad96 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:48.588716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f1b5-c3cc-4906-a37f-e2d3f8a7ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:48.588993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f1b5-c3cc-4906-a37f-e2d3f8a7ad96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:48.656239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f1b5-c3cc-4906-a37f-e2d3f8a7ad96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:48.657744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f1b5-c3cc-4906-a37f-e2d3f8a7ad96 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:48.754591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 157/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:48.759719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84767b-1abb-4b08-a471-dc266544fc24 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:48.860691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84767b-1abb-4b08-a471-dc266544fc24 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:48.894371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb00c80-07ce-4874-b5a9-68962caa7643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:48.895607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb00c80-07ce-4874-b5a9-68962caa7643 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:48.896093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb00c80-07ce-4874-b5a9-68962caa7643 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:48.896569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb00c80-07ce-4874-b5a9-68962caa7643 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:48.898004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb00c80-07ce-4874-b5a9-68962caa7643 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:48.899732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb00c80-07ce-4874-b5a9-68962caa7643 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:48.902218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 160/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:48 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:48.908014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f1b5-c3cc-4906-a37f-e2d3f8a7ad96 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:49.022716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f1b5-c3cc-4906-a37f-e2d3f8a7ad96 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:49.057960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688cff2-f744-4f42-a8c5-aee5cb8710f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:49.059017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688cff2-f744-4f42-a8c5-aee5cb8710f0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:49.059497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688cff2-f744-4f42-a8c5-aee5cb8710f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:49.059961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688cff2-f744-4f42-a8c5-aee5cb8710f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:49.060997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688cff2-f744-4f42-a8c5-aee5cb8710f0 None admin] RBAC: Adding query filter params (role.id=d3c2851744d94b809dac16599fa42789, scope.project.id=6c9ffaa9059441daacf4f61653c20168, user.id=28bfe97c81904d7994481ac47b12207c) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:49.061519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688cff2-f744-4f42-a8c5-aee5cb8710f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:49.063192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688cff2-f744-4f42-a8c5-aee5cb8710f0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:49.070022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 158/318] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:45:48 2022] GET /identity/v3/role_assignments?user.id=28bfe97c81904d7994481ac47b12207c&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=d3c2851744d94b809dac16599fa42789 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:49.458750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef9046-6743-4f94-a759-a02c44a56911 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:49.459119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef9046-6743-4f94-a759-a02c44a56911 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:49.459314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef9046-6743-4f94-a759-a02c44a56911 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:49.460869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 161/319] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:49.466515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc06fd-1a94-4040-a109-c1f8b0f5da94 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:49.466802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc06fd-1a94-4040-a109-c1f8b0f5da94 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:49.467067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc06fd-1a94-4040-a109-c1f8b0f5da94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:49.483692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-bfbc06fd-1a94-4040-a109-c1f8b0f5da94 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:49.484865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-bfbc06fd-1a94-4040-a109-c1f8b0f5da94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:49.545016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8802e-4195-4c6d-89f1-9b937abc4f9e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:49.545333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8802e-4195-4c6d-89f1-9b937abc4f9e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:49.545624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8802e-4195-4c6d-89f1-9b937abc4f9e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:49.547377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 162/320] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:45:49.549913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 159/321] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:49.552383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816b4e6-0c1d-4564-baff-4b9d5c4bc2a0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:49.552673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816b4e6-0c1d-4564-baff-4b9d5c4bc2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:49.552950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816b4e6-0c1d-4564-baff-4b9d5c4bc2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:49.569668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f816b4e6-0c1d-4564-baff-4b9d5c4bc2a0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:49.571244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f816b4e6-0c1d-4564-baff-4b9d5c4bc2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:49.572034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc06fd-1a94-4040-a109-c1f8b0f5da94 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:49.636769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 163/322] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:49.658491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816b4e6-0c1d-4564-baff-4b9d5c4bc2a0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:49.670178 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc06fd-1a94-4040-a109-c1f8b0f5da94 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:49.709774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ff40d-3277-4768-9e7d-13dc819da763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:49.710842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ff40d-3277-4768-9e7d-13dc819da763 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:49.711729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ff40d-3277-4768-9e7d-13dc819da763 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:49.712200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ff40d-3277-4768-9e7d-13dc819da763 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:49.724991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ff40d-3277-4768-9e7d-13dc819da763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-156ff40d-3277-4768-9e7d-13dc819da763 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:49.734362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:49.735219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:49.736010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:49.742604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 160/323] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:49.743449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ff40d-3277-4768-9e7d-13dc819da763 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:49.755954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816b4e6-0c1d-4564-baff-4b9d5c4bc2a0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:49.788478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9b1e6-0a3a-4f7c-902a-9f1c750b2d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:49.789351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9b1e6-0a3a-4f7c-902a-9f1c750b2d22 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:49.789664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9b1e6-0a3a-4f7c-902a-9f1c750b2d22 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:49.790005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9b1e6-0a3a-4f7c-902a-9f1c750b2d22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:49.791147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9b1e6-0a3a-4f7c-902a-9f1c750b2d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:49.793089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9b1e6-0a3a-4f7c-902a-9f1c750b2d22 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:49.797945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 164/324] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:45:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:49.800688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9b1e6-0a3a-4f7c-902a-9f1c750b2d22 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:49.842944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ff40d-3277-4768-9e7d-13dc819da763 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:49.877029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c11309-6993-43d5-8d75-8be4a9a6e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:49.878067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c11309-6993-43d5-8d75-8be4a9a6e331 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:49.878411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c11309-6993-43d5-8d75-8be4a9a6e331 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:49.878691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c11309-6993-43d5-8d75-8be4a9a6e331 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:49.879437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c11309-6993-43d5-8d75-8be4a9a6e331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:49.879742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c11309-6993-43d5-8d75-8be4a9a6e331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:49.881097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c11309-6993-43d5-8d75-8be4a9a6e331 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:49.889017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 161/325] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:49.894539 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c11309-6993-43d5-8d75-8be4a9a6e331 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:49.895650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9b1e6-0a3a-4f7c-902a-9f1c750b2d22 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:49.929738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ffa59-1d41-4318-9b74-e8561f037740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:49.930398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ffa59-1d41-4318-9b74-e8561f037740 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:49.930676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ffa59-1d41-4318-9b74-e8561f037740 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:49.930950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ffa59-1d41-4318-9b74-e8561f037740 None admin] PATH_INFO: `/v3/groups` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:49.931632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ffa59-1d41-4318-9b74-e8561f037740 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:49.933639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ffa59-1d41-4318-9b74-e8561f037740 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:49.948144 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 165/326] 10.222.0.48 () {60 vars in 1134 bytes} [Thu May 12 18:45:49 2022] POST /identity/v3/groups => generated 226 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:45:50.001045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c11309-6993-43d5-8d75-8be4a9a6e331 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:50.035721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee2e01-3dd4-4c79-8d31-5b4416e1568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:50.036614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee2e01-3dd4-4c79-8d31-5b4416e1568d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:50.036897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee2e01-3dd4-4c79-8d31-5b4416e1568d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:50.037170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee2e01-3dd4-4c79-8d31-5b4416e1568d None admin] PATH_INFO: `/v3/users/f970ee85d064401e91488f8512764d93` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:50.038463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee2e01-3dd4-4c79-8d31-5b4416e1568d None admin] RBAC: Authorizing `identity:get_user(user_id=f970ee85d064401e91488f8512764d93)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:50.039936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee2e01-3dd4-4c79-8d31-5b4416e1568d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:50.042440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 162/327] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:49 2022] GET /identity/v3/users/f970ee85d064401e91488f8512764d93 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:50.048227 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ffa59-1d41-4318-9b74-e8561f037740 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:50.157995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ffa59-1d41-4318-9b74-e8561f037740 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:50.192278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d35c9c-4d28-41b9-acd3-6324c700c958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:50.193130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d35c9c-4d28-41b9-acd3-6324c700c958 None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:50.193407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d35c9c-4d28-41b9-acd3-6324c700c958 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:50.193709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d35c9c-4d28-41b9-acd3-6324c700c958 None admin] PATH_INFO: `/v3/system/users/f970ee85d064401e91488f8512764d93/roles/d3c2851744d94b809dac16599fa42789` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:50.195183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d35c9c-4d28-41b9-acd3-6324c700c958 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f970ee85d064401e91488f8512764d93, role_id=d3c2851744d94b809dac16599fa42789)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:50.196572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d35c9c-4d28-41b9-acd3-6324c700c958 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:50.205007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 166/328] 10.222.0.48 () {58 vars in 1334 bytes} [Thu May 12 18:45:50 2022] PUT /identity/v3/system/users/f970ee85d064401e91488f8512764d93/roles/d3c2851744d94b809dac16599fa42789 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:50.606790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee32f51-3067-4fc1-845e-c38e191413d4 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:50.606790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee32f51-3067-4fc1-845e-c38e191413d4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:50.606790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee32f51-3067-4fc1-845e-c38e191413d4 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:50.607904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 163/329] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:50.613722 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b035-21a0-4759-8817-7692cc43d30e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:50.614263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b035-21a0-4759-8817-7692cc43d30e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:50.614744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b035-21a0-4759-8817-7692cc43d30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:50.638537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-37a5b035-21a0-4759-8817-7692cc43d30e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:50.640073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-37a5b035-21a0-4759-8817-7692cc43d30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:50.720605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 167/330] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:50.745702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee32f51-3067-4fc1-845e-c38e191413d4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:50.869452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee32f51-3067-4fc1-845e-c38e191413d4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:50.911649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8c18-5f44-4e19-b163-ad364bf8abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:50.912803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8c18-5f44-4e19-b163-ad364bf8abba None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:50.913289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8c18-5f44-4e19-b163-ad364bf8abba None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:50.913851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8c18-5f44-4e19-b163-ad364bf8abba None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:50.926565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c8c18-5f44-4e19-b163-ad364bf8abba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-513c8c18-5f44-4e19-b163-ad364bf8abba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:50.935204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:50.936128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:50.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:50.944433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 164/331] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:50.946703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b035-21a0-4759-8817-7692cc43d30e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:51.091183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b035-21a0-4759-8817-7692cc43d30e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:51.135089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809faf5d-9235-4f5a-8e02-a433d1fab137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:51.136333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809faf5d-9235-4f5a-8e02-a433d1fab137 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:51.136621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809faf5d-9235-4f5a-8e02-a433d1fab137 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:51.136901 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809faf5d-9235-4f5a-8e02-a433d1fab137 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:51.137681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809faf5d-9235-4f5a-8e02-a433d1fab137 None admin] RBAC: Adding query filter params (name=member) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:51.137997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809faf5d-9235-4f5a-8e02-a433d1fab137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:51.139370 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809faf5d-9235-4f5a-8e02-a433d1fab137 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:51.152952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 168/332] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:51.158891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8c18-5f44-4e19-b163-ad364bf8abba None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:51.296203 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8c18-5f44-4e19-b163-ad364bf8abba None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:51.340131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335487a5-6426-4a2f-b989-9a87642afb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:51.341356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335487a5-6426-4a2f-b989-9a87642afb1d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:51.341898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335487a5-6426-4a2f-b989-9a87642afb1d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:51.342375 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335487a5-6426-4a2f-b989-9a87642afb1d None admin] PATH_INFO: `/v3/users/30a8c88918804021a1858e1fa7d2ad7c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:51.343793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335487a5-6426-4a2f-b989-9a87642afb1d None admin] RBAC: Authorizing `identity:get_user(user_id=30a8c88918804021a1858e1fa7d2ad7c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:51.345441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335487a5-6426-4a2f-b989-9a87642afb1d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:51.348582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 165/333] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:51 2022] GET /identity/v3/users/30a8c88918804021a1858e1fa7d2ad7c => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:51.353688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809faf5d-9235-4f5a-8e02-a433d1fab137 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:51.492735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809faf5d-9235-4f5a-8e02-a433d1fab137 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:51.535111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a697a-a762-432e-996c-4d2a79192f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:51.535773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a697a-a762-432e-996c-4d2a79192f02 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:51.536059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a697a-a762-432e-996c-4d2a79192f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:51.536342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a697a-a762-432e-996c-4d2a79192f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:51.537175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a697a-a762-432e-996c-4d2a79192f02 None admin] RBAC: Adding query filter params (role.id=4a765555b657413ea79721175a7191e3, user.id=30a8c88918804021a1858e1fa7d2ad7c, scope.system=all) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:51.537488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a697a-a762-432e-996c-4d2a79192f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:51.538964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a697a-a762-432e-996c-4d2a79192f02 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:51.555807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 169/334] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 12 18:45:51 2022] GET /identity/v3/role_assignments?user.id=30a8c88918804021a1858e1fa7d2ad7c&scope.system=all&role.id=4a765555b657413ea79721175a7191e3 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:52.529954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bdee5-87c6-4073-9662-2723e9978579 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:52.530469 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bdee5-87c6-4073-9662-2723e9978579 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:52.530543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bdee5-87c6-4073-9662-2723e9978579 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:52.532166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 166/335] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:52.547035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b6917-82fd-437c-a207-55aeba15206d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:52.547522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b6917-82fd-437c-a207-55aeba15206d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:52.547597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b6917-82fd-437c-a207-55aeba15206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:52.570592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-5b0b6917-82fd-437c-a207-55aeba15206d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:52.571914 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5b0b6917-82fd-437c-a207-55aeba15206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:52.651154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 170/336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:52.700321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bdee5-87c6-4073-9662-2723e9978579 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:52.823339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bdee5-87c6-4073-9662-2723e9978579 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:52.860963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e207cb9-ec89-4801-800d-cefefdcbec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:52.861803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207cb9-ec89-4801-800d-cefefdcbec23 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:52.862087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207cb9-ec89-4801-800d-cefefdcbec23 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:52.862364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207cb9-ec89-4801-800d-cefefdcbec23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:52.878810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e207cb9-ec89-4801-800d-cefefdcbec23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4e207cb9-ec89-4801-800d-cefefdcbec23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:52.886653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:52.887553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:52.889772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 167/337] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:52.893749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b6917-82fd-437c-a207-55aeba15206d None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:53.046222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b6917-82fd-437c-a207-55aeba15206d None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:53.080205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d876215-2bf7-4e91-a2f5-429864bcdf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:53.080797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d876215-2bf7-4e91-a2f5-429864bcdf90 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:53.081073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d876215-2bf7-4e91-a2f5-429864bcdf90 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:53.081346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d876215-2bf7-4e91-a2f5-429864bcdf90 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:53.082117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d876215-2bf7-4e91-a2f5-429864bcdf90 None admin] RBAC: Adding query filter params (name=member) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:53.082421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d876215-2bf7-4e91-a2f5-429864bcdf90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:53.083780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d876215-2bf7-4e91-a2f5-429864bcdf90 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:53.097310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 171/338] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:53.102523 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e207cb9-ec89-4801-800d-cefefdcbec23 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:53.226656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e207cb9-ec89-4801-800d-cefefdcbec23 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:53.268899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb16a2-0be1-4012-9af8-37aa654aa0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:53.269601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb16a2-0be1-4012-9af8-37aa654aa0f4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:53.269892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb16a2-0be1-4012-9af8-37aa654aa0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:53.270171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb16a2-0be1-4012-9af8-37aa654aa0f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:53.290365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6b6e5-c1f6-47cf-892a-3a02a603f489 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:53.290654 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6b6e5-c1f6-47cf-892a-3a02a603f489 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:53.291099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6b6e5-c1f6-47cf-892a-3a02a603f489 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:53.297995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 172/339] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:53.299893 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6315-9b39-432a-9fef-b76c2336a81b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:53.300386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6315-9b39-432a-9fef-b76c2336a81b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:53.300862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6315-9b39-432a-9fef-b76c2336a81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:53.342645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-496d6315-9b39-432a-9fef-b76c2336a81b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:53.344171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-496d6315-9b39-432a-9fef-b76c2336a81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:53.352965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb16a2-0be1-4012-9af8-37aa654aa0f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:53.355436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb16a2-0be1-4012-9af8-37aa654aa0f4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:53.471097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 168/340] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:53.483463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb16a2-0be1-4012-9af8-37aa654aa0f4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:53.516461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 173/341] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:53.554591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6315-9b39-432a-9fef-b76c2336a81b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:53.595331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb16a2-0be1-4012-9af8-37aa654aa0f4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:53.640116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c178d65-c7e4-4757-b3a8-16015fc2e3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:53.641008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178d65-c7e4-4757-b3a8-16015fc2e3e7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:53.641297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178d65-c7e4-4757-b3a8-16015fc2e3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:53.641595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178d65-c7e4-4757-b3a8-16015fc2e3e7 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:53.644696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c178d65-c7e4-4757-b3a8-16015fc2e3e7 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:53.646190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c178d65-c7e4-4757-b3a8-16015fc2e3e7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:53.647908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 169/342] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:53 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:53.654029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c178d65-c7e4-4757-b3a8-16015fc2e3e7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:53.764398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6315-9b39-432a-9fef-b76c2336a81b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:53.845655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c178d65-c7e4-4757-b3a8-16015fc2e3e7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:53.866235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff864-9775-4955-8507-28bd5278b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:53.867042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff864-9775-4955-8507-28bd5278b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:53.867323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff864-9775-4955-8507-28bd5278b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:53.867595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff864-9775-4955-8507-28bd5278b9c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:53.887414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08b7b9-350e-43b7-b7df-efd93d2cf491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:53.888279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b7b9-350e-43b7-b7df-efd93d2cf491 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:53.888562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b7b9-350e-43b7-b7df-efd93d2cf491 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:53.888839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b7b9-350e-43b7-b7df-efd93d2cf491 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:53.890104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dff864-9775-4955-8507-28bd5278b9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-b7dff864-9775-4955-8507-28bd5278b9c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:53.897956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:53.898911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 18:45:53.899705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:53.906000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08b7b9-350e-43b7-b7df-efd93d2cf491 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:53.907474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08b7b9-350e-43b7-b7df-efd93d2cf491 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:53.909195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 170/343] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:45:53 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:53.910603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 174/344] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:53.911508 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff864-9775-4955-8507-28bd5278b9c8 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:53.912121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da832-2cf9-4b06-b617-535ec3f83ba7 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:53.912408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da832-2cf9-4b06-b617-535ec3f83ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:53.912683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da832-2cf9-4b06-b617-535ec3f83ba7 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:53.913989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 171/345] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:53.917404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9da832-2cf9-4b06-b617-535ec3f83ba7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:54.065715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9da832-2cf9-4b06-b617-535ec3f83ba7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:54.088911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff864-9775-4955-8507-28bd5278b9c8 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:54.114160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27cafd-5fdd-40ed-9c4c-1458006ffe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:54.114746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27cafd-5fdd-40ed-9c4c-1458006ffe39 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.115031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27cafd-5fdd-40ed-9c4c-1458006ffe39 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.115307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27cafd-5fdd-40ed-9c4c-1458006ffe39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.116146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27cafd-5fdd-40ed-9c4c-1458006ffe39 None admin] RBAC: Adding query filter params (group.id=312887f25def4d1082e95c52181aaab0, role.id=4a765555b657413ea79721175a7191e3, scope.project.id=cb46cdbaf65d4668a7a32126ba096340) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:54.116459 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27cafd-5fdd-40ed-9c4c-1458006ffe39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:54.117990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27cafd-5fdd-40ed-9c4c-1458006ffe39 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:54.124362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 172/346] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:45:53 2022] GET /identity/v3/role_assignments?group.id=312887f25def4d1082e95c52181aaab0&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=4a765555b657413ea79721175a7191e3 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:54.125639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba7de6-26cf-460e-ad08-0a99964ae9cd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.125975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba7de6-26cf-460e-ad08-0a99964ae9cd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.126258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba7de6-26cf-460e-ad08-0a99964ae9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.147119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3b7b1-3beb-41ef-a847-d7ff8117a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:54.147924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3b7b1-3beb-41ef-a847-d7ff8117a767 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.148210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3b7b1-3beb-41ef-a847-d7ff8117a767 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.148488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3b7b1-3beb-41ef-a847-d7ff8117a767 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.149260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3b7b1-3beb-41ef-a847-d7ff8117a767 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:54.149633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3b7b1-3beb-41ef-a847-d7ff8117a767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:54.151897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3b7b1-3beb-41ef-a847-d7ff8117a767 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:54.154529 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-eeba7de6-26cf-460e-ad08-0a99964ae9cd None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:54.155754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-eeba7de6-26cf-460e-ad08-0a99964ae9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:54.161912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 175/347] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:54.164569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7edfe1-91ee-4901-8735-d1126a29ba8f None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.164877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7edfe1-91ee-4901-8735-d1126a29ba8f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.165157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7edfe1-91ee-4901-8735-d1126a29ba8f None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.169152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 176/348] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:54.172889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7edfe1-91ee-4901-8735-d1126a29ba8f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:54.283547 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 173/349] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:54.285794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983a169-fabc-49f6-b641-9017fde15783 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.286090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983a169-fabc-49f6-b641-9017fde15783 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.286372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983a169-fabc-49f6-b641-9017fde15783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.317731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6983a169-fabc-49f6-b641-9017fde15783 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:54.318954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6983a169-fabc-49f6-b641-9017fde15783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:54.368582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7edfe1-91ee-4901-8735-d1126a29ba8f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:54.433727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 174/350] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:54.434022 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b65daa-e500-46a4-acf5-40449bc8f26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:54.434592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983a169-fabc-49f6-b641-9017fde15783 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:54.434895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b65daa-e500-46a4-acf5-40449bc8f26a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.435180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b65daa-e500-46a4-acf5-40449bc8f26a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.435458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b65daa-e500-46a4-acf5-40449bc8f26a None admin] PATH_INFO: `/v3/users/f970ee85d064401e91488f8512764d93` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.436699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b65daa-e500-46a4-acf5-40449bc8f26a None admin] RBAC: Authorizing `identity:get_user(user_id=f970ee85d064401e91488f8512764d93)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:54.438194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b65daa-e500-46a4-acf5-40449bc8f26a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:54.439829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 177/351] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:45:54 2022] GET /identity/v3/users/f970ee85d064401e91488f8512764d93 => generated 293 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:54.445851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b65daa-e500-46a4-acf5-40449bc8f26a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:54.546404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983a169-fabc-49f6-b641-9017fde15783 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:54.569304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b65daa-e500-46a4-acf5-40449bc8f26a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:54.589621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8ae84-160e-42ea-8a54-f31f7cce5c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:54.590447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8ae84-160e-42ea-8a54-f31f7cce5c72 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.590729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8ae84-160e-42ea-8a54-f31f7cce5c72 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.591001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8ae84-160e-42ea-8a54-f31f7cce5c72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.607922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd3cf9-d52b-44cc-b92b-60d223e467c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:54.608609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd3cf9-d52b-44cc-b92b-60d223e467c7 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.608894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd3cf9-d52b-44cc-b92b-60d223e467c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.609171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd3cf9-d52b-44cc-b92b-60d223e467c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.610062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd3cf9-d52b-44cc-b92b-60d223e467c7 None admin] RBAC: Adding query filter params (role.id=d3c2851744d94b809dac16599fa42789, user.id=f970ee85d064401e91488f8512764d93, scope.system=all) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:54.610379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd3cf9-d52b-44cc-b92b-60d223e467c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:54.611839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd3cf9-d52b-44cc-b92b-60d223e467c7 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:54.615246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8ae84-160e-42ea-8a54-f31f7cce5c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:54.624671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 178/352] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 12 18:45:54 2022] GET /identity/v3/role_assignments?user.id=f970ee85d064401e91488f8512764d93&scope.system=all&role.id=d3c2851744d94b809dac16599fa42789 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:54.625453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd3cf9-d52b-44cc-b92b-60d223e467c7 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e5b8ae84-160e-42ea-8a54-f31f7cce5c72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:54.627531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:54.629625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:54.631605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 175/353] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:45:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:54.635865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8ae84-160e-42ea-8a54-f31f7cce5c72 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:54.735964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd3cf9-d52b-44cc-b92b-60d223e467c7 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:54.772470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c426c-76b1-4455-9090-edd287838e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:54.773276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c426c-76b1-4455-9090-edd287838e67 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.773582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c426c-76b1-4455-9090-edd287838e67 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.773865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c426c-76b1-4455-9090-edd287838e67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.783248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8ae84-160e-42ea-8a54-f31f7cce5c72 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:54.785193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c426c-76b1-4455-9090-edd287838e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-695c426c-76b1-4455-9090-edd287838e67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:54.793058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:54.795186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:54.797439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 179/354] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:54.805667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c426c-76b1-4455-9090-edd287838e67 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:54.835901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef27d3-6529-48f0-bc81-04ac096c6dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:54.836998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef27d3-6529-48f0-bc81-04ac096c6dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.837488 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef27d3-6529-48f0-bc81-04ac096c6dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.838038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef27d3-6529-48f0-bc81-04ac096c6dd1 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.839033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef27d3-6529-48f0-bc81-04ac096c6dd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:54.839536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef27d3-6529-48f0-bc81-04ac096c6dd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:54.841155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef27d3-6529-48f0-bc81-04ac096c6dd1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:54.860712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 176/355] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:45:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:54.866241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef27d3-6529-48f0-bc81-04ac096c6dd1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:54.905705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c426c-76b1-4455-9090-edd287838e67 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:54.946236 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2edf1-e73d-4efe-b55a-2d74b755e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:54.946921 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2edf1-e73d-4efe-b55a-2d74b755e582 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:54.947206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2edf1-e73d-4efe-b55a-2d74b755e582 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:54.947484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2edf1-e73d-4efe-b55a-2d74b755e582 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:54.948806 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2edf1-e73d-4efe-b55a-2d74b755e582 None admin] RBAC: Adding query filter params (name=member) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:54.949117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2edf1-e73d-4efe-b55a-2d74b755e582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:54.950539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2edf1-e73d-4efe-b55a-2d74b755e582 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:54.959457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 180/356] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:54.964906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2edf1-e73d-4efe-b55a-2d74b755e582 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:55.050749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef27d3-6529-48f0-bc81-04ac096c6dd1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:55.073497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2edf1-e73d-4efe-b55a-2d74b755e582 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:55.095579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a44068-8023-48ab-8384-e0de8d2b4245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:55.096239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a44068-8023-48ab-8384-e0de8d2b4245 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.096520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a44068-8023-48ab-8384-e0de8d2b4245 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.096790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a44068-8023-48ab-8384-e0de8d2b4245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.107779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838d4fb-a11e-42a2-a67f-cb3ac376e337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:55.108432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838d4fb-a11e-42a2-a67f-cb3ac376e337 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.108721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838d4fb-a11e-42a2-a67f-cb3ac376e337 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.108996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838d4fb-a11e-42a2-a67f-cb3ac376e337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.169116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a44068-8023-48ab-8384-e0de8d2b4245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:55.169116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a44068-8023-48ab-8384-e0de8d2b4245 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:55.181259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838d4fb-a11e-42a2-a67f-cb3ac376e337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:55.183344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838d4fb-a11e-42a2-a67f-cb3ac376e337 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:55.275354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 177/357] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:45:55.276934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d8e2e-e63a-4f77-8e4c-958cd6fdac9f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.277212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d8e2e-e63a-4f77-8e4c-958cd6fdac9f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.277489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d8e2e-e63a-4f77-8e4c-958cd6fdac9f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.278788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 178/358] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:55.283911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d8e2e-e63a-4f77-8e4c-958cd6fdac9f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:55.292183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 181/359] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:45:55.293331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a434f8-ba7b-43d1-a7d2-233f904551e8 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.297705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a434f8-ba7b-43d1-a7d2-233f904551e8 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.298016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a434f8-ba7b-43d1-a7d2-233f904551e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.317174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-21a434f8-ba7b-43d1-a7d2-233f904551e8 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:55.318416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-21a434f8-ba7b-43d1-a7d2-233f904551e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:55.386080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 182/360] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:55.386757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a434f8-ba7b-43d1-a7d2-233f904551e8 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:55.387871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d8e2e-e63a-4f77-8e4c-958cd6fdac9f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:55.423612 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9e06-f051-45d6-b16a-e6feaf166a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:55.424437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9e06-f051-45d6-b16a-e6feaf166a63 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.424723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9e06-f051-45d6-b16a-e6feaf166a63 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.424997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9e06-f051-45d6-b16a-e6feaf166a63 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.426284 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde9e06-f051-45d6-b16a-e6feaf166a63 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:55.427771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde9e06-f051-45d6-b16a-e6feaf166a63 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:55.429880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 179/361] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:55 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:55.430783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9e06-f051-45d6-b16a-e6feaf166a63 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:55.490618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a434f8-ba7b-43d1-a7d2-233f904551e8 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:55.531903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27826-c95e-4964-91c2-fb683750e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:55.532758 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27826-c95e-4964-91c2-fb683750e971 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.533040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27826-c95e-4964-91c2-fb683750e971 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.533314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27826-c95e-4964-91c2-fb683750e971 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.534576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27826-c95e-4964-91c2-fb683750e971 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:55.536095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27826-c95e-4964-91c2-fb683750e971 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:55.537838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 183/362] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:55 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:55.538592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27826-c95e-4964-91c2-fb683750e971 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:55.553064 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9e06-f051-45d6-b16a-e6feaf166a63 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:55.599563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bd0a1-8229-4d15-a859-db70cee9973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:55.600376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bd0a1-8229-4d15-a859-db70cee9973d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.600656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bd0a1-8229-4d15-a859-db70cee9973d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.600928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bd0a1-8229-4d15-a859-db70cee9973d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.616683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bd0a1-8229-4d15-a859-db70cee9973d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-f38bd0a1-8229-4d15-a859-db70cee9973d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:55.625493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:55.626491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:55.627732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 180/363] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:45:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:55.628446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f7dd-59c4-4ff4-afd1-a9baeaba5683 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.628518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f7dd-59c4-4ff4-afd1-a9baeaba5683 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.629264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f7dd-59c4-4ff4-afd1-a9baeaba5683 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.632226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 181/364] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:55.632226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54f7dd-59c4-4ff4-afd1-a9baeaba5683 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:55.674135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27826-c95e-4964-91c2-fb683750e971 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:55.717797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3dbf9-b989-45fd-9b77-d5b8de521ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:55.719833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3dbf9-b989-45fd-9b77-d5b8de521ec8 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.720387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3dbf9-b989-45fd-9b77-d5b8de521ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.720859 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3dbf9-b989-45fd-9b77-d5b8de521ec8 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.722600 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3dbf9-b989-45fd-9b77-d5b8de521ec8 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:55.724354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3dbf9-b989-45fd-9b77-d5b8de521ec8 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:55.726708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 184/365] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:45:55 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:55.728176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768df57-43fb-4a76-b966-60da330c92b9 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.728895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768df57-43fb-4a76-b966-60da330c92b9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.728895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768df57-43fb-4a76-b966-60da330c92b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.748531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1768df57-43fb-4a76-b966-60da330c92b9 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:55.750087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1768df57-43fb-4a76-b966-60da330c92b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:55.774522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54f7dd-59c4-4ff4-afd1-a9baeaba5683 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:55.818305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef238ab3-bdb9-42cc-82e8-9d975b8544fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:55.819530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef238ab3-bdb9-42cc-82e8-9d975b8544fe None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.819822 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef238ab3-bdb9-42cc-82e8-9d975b8544fe None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.820101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef238ab3-bdb9-42cc-82e8-9d975b8544fe None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.822214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef238ab3-bdb9-42cc-82e8-9d975b8544fe None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:55.824164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef238ab3-bdb9-42cc-82e8-9d975b8544fe None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:55.826046 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 182/366] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:45:55 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:55.826904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef238ab3-bdb9-42cc-82e8-9d975b8544fe None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:55.841402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 185/367] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:55.842680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768df57-43fb-4a76-b966-60da330c92b9 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:55.939063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef238ab3-bdb9-42cc-82e8-9d975b8544fe None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:55.958475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768df57-43fb-4a76-b966-60da330c92b9 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:55.977387 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44e61-eb56-4c26-8c43-f8334096127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:55.978093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44e61-eb56-4c26-8c43-f8334096127e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:55.978378 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44e61-eb56-4c26-8c43-f8334096127e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:55.978657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44e61-eb56-4c26-8c43-f8334096127e None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:55.979958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee44e61-eb56-4c26-8c43-f8334096127e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:55.980271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee44e61-eb56-4c26-8c43-f8334096127e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:55.981675 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee44e61-eb56-4c26-8c43-f8334096127e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:55.989947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 183/368] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:45:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:55.991055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44e61-eb56-4c26-8c43-f8334096127e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:55.999675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052597f-b7d9-436e-8bfa-5a4d2b7b9c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:56.000333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052597f-b7d9-436e-8bfa-5a4d2b7b9c6b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:56.000616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052597f-b7d9-436e-8bfa-5a4d2b7b9c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:56.000893 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052597f-b7d9-436e-8bfa-5a4d2b7b9c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:56.001755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052597f-b7d9-436e-8bfa-5a4d2b7b9c6b None admin] RBAC: Adding query filter params (group.id=312887f25def4d1082e95c52181aaab0, role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=cb46cdbaf65d4668a7a32126ba096340) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:56.002068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052597f-b7d9-436e-8bfa-5a4d2b7b9c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:56.003511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052597f-b7d9-436e-8bfa-5a4d2b7b9c6b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:56.012769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 186/369] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:45:55 2022] GET /identity/v3/role_assignments?group.id=312887f25def4d1082e95c52181aaab0&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:56.013739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052597f-b7d9-436e-8bfa-5a4d2b7b9c6b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:56.116536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44e61-eb56-4c26-8c43-f8334096127e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:56.144531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052597f-b7d9-436e-8bfa-5a4d2b7b9c6b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:56.156920 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cc8cc-9954-46ef-8303-ede7cb9e31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:56.157636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cc8cc-9954-46ef-8303-ede7cb9e31f2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:56.157927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cc8cc-9954-46ef-8303-ede7cb9e31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:56.158208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cc8cc-9954-46ef-8303-ede7cb9e31f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:56.159122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cc8cc-9954-46ef-8303-ede7cb9e31f2 None admin] RBAC: Adding query filter params (group.id=312887f25def4d1082e95c52181aaab0, role.id=4a765555b657413ea79721175a7191e3, scope.project.id=6c9ffaa9059441daacf4f61653c20168) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:56.159438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cc8cc-9954-46ef-8303-ede7cb9e31f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:56.160952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cc8cc-9954-46ef-8303-ede7cb9e31f2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:56.169007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 184/370] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:45:55 2022] GET /identity/v3/role_assignments?group.id=312887f25def4d1082e95c52181aaab0&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=4a765555b657413ea79721175a7191e3 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:56.170058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cc8cc-9954-46ef-8303-ede7cb9e31f2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:56.199563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f29b0-e7bb-4643-a597-26720a346cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:56.200281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f29b0-e7bb-4643-a597-26720a346cef None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:56.200554 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f29b0-e7bb-4643-a597-26720a346cef None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:56.200822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f29b0-e7bb-4643-a597-26720a346cef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:56.223435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f29b0-e7bb-4643-a597-26720a346cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-992f29b0-e7bb-4643-a597-26720a346cef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:56.240053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:56.241046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:45:56.241857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 187/371] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:45:56.247199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f29b0-e7bb-4643-a597-26720a346cef None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:56.286829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cc8cc-9954-46ef-8303-ede7cb9e31f2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:56.324452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085932b-9d8d-40a7-bc49-cc38955f816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:56.325117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085932b-9d8d-40a7-bc49-cc38955f816d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:56.325403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085932b-9d8d-40a7-bc49-cc38955f816d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:56.325714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085932b-9d8d-40a7-bc49-cc38955f816d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:56.404860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f29b0-e7bb-4643-a597-26720a346cef None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:56.423121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085932b-9d8d-40a7-bc49-cc38955f816d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:56.424832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085932b-9d8d-40a7-bc49-cc38955f816d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:56.447383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb8634-6a9d-41bc-b8ab-620f52c54bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:56.448094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb8634-6a9d-41bc-b8ab-620f52c54bce None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:56.448375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb8634-6a9d-41bc-b8ab-620f52c54bce None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:56.448646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb8634-6a9d-41bc-b8ab-620f52c54bce None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:56.449789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb8634-6a9d-41bc-b8ab-620f52c54bce None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:56.450039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb8634-6a9d-41bc-b8ab-620f52c54bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:56.451994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb8634-6a9d-41bc-b8ab-620f52c54bce None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:56.464439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 188/372] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:56.469387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb8634-6a9d-41bc-b8ab-620f52c54bce None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:56.536504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 185/373] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:45:56.542268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085932b-9d8d-40a7-bc49-cc38955f816d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:56.597290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb8634-6a9d-41bc-b8ab-620f52c54bce None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:56.653904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085932b-9d8d-40a7-bc49-cc38955f816d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:56.662197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e68d5-22e0-4de9-94b2-d997686efdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:56.663085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e68d5-22e0-4de9-94b2-d997686efdb6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:56.663574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e68d5-22e0-4de9-94b2-d997686efdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:56.664041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e68d5-22e0-4de9-94b2-d997686efdb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:56.695919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73728e91-17f6-4cde-9ce4-c7d519381472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:56.696795 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73728e91-17f6-4cde-9ce4-c7d519381472 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:56.697080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73728e91-17f6-4cde-9ce4-c7d519381472 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:56.697355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73728e91-17f6-4cde-9ce4-c7d519381472 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:56.703602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73728e91-17f6-4cde-9ce4-c7d519381472 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:56.705010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73728e91-17f6-4cde-9ce4-c7d519381472 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:56.706816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 186/374] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:56 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:56.712399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73728e91-17f6-4cde-9ce4-c7d519381472 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:56.803568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e68d5-22e0-4de9-94b2-d997686efdb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:56.805020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e68d5-22e0-4de9-94b2-d997686efdb6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:56.859137 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73728e91-17f6-4cde-9ce4-c7d519381472 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:56.908478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c840368-a7d9-46d9-8bca-6ea40a7a4c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:56.909761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c840368-a7d9-46d9-8bca-6ea40a7a4c41 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:56.910274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c840368-a7d9-46d9-8bca-6ea40a7a4c41 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:56.910755 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c840368-a7d9-46d9-8bca-6ea40a7a4c41 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:56.912697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c840368-a7d9-46d9-8bca-6ea40a7a4c41 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:56.914496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c840368-a7d9-46d9-8bca-6ea40a7a4c41 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:56.916736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 187/375] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:45:56 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:56.922553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c840368-a7d9-46d9-8bca-6ea40a7a4c41 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:57.024670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 189/376] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:45:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:45:57.029725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e68d5-22e0-4de9-94b2-d997686efdb6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:57.037034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c840368-a7d9-46d9-8bca-6ea40a7a4c41 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:57.080821 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d9e97-cd36-4441-b89a-c93754285f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:57.082310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d9e97-cd36-4441-b89a-c93754285f1e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:57.082805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d9e97-cd36-4441-b89a-c93754285f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:57.083288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d9e97-cd36-4441-b89a-c93754285f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:57.084343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d9e97-cd36-4441-b89a-c93754285f1e None admin] RBAC: Adding query filter params (group.id=312887f25def4d1082e95c52181aaab0, role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=6c9ffaa9059441daacf4f61653c20168) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:57.085278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d9e97-cd36-4441-b89a-c93754285f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:57.087431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d9e97-cd36-4441-b89a-c93754285f1e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:57.094761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 188/377] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:45:56 2022] GET /identity/v3/role_assignments?group.id=312887f25def4d1082e95c52181aaab0&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:57.096580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad866-6769-49a7-b418-f0905ad324b1 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:57.097427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad866-6769-49a7-b418-f0905ad324b1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:57.097955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad866-6769-49a7-b418-f0905ad324b1 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:57.100131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 189/378] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:57.106514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f226-ea3e-44ed-a589-afff065792c6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:57.108055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f226-ea3e-44ed-a589-afff065792c6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:57.108593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f226-ea3e-44ed-a589-afff065792c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:57.133767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8633f226-ea3e-44ed-a589-afff065792c6 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:57.136720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8633f226-ea3e-44ed-a589-afff065792c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:57.149200 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e68d5-22e0-4de9-94b2-d997686efdb6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:57.199910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c401134-ffc1-4fac-aa55-ed8f7ef50dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:57.200829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c401134-ffc1-4fac-aa55-ed8f7ef50dbc None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:57.201164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c401134-ffc1-4fac-aa55-ed8f7ef50dbc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:57.201491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c401134-ffc1-4fac-aa55-ed8f7ef50dbc None admin] PATH_INFO: `/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:57.203436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c401134-ffc1-4fac-aa55-ed8f7ef50dbc None admin] RBAC: Authorizing `identity:get_project(project_id=039d8e8cc62f44a2bdf4d5f5334c1312)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:57.205680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c401134-ffc1-4fac-aa55-ed8f7ef50dbc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:57.207422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 190/379] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:57 2022] GET /identity/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:57.213394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c401134-ffc1-4fac-aa55-ed8f7ef50dbc None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:57.220048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 190/380] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:57.254808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633f226-ea3e-44ed-a589-afff065792c6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:57.333419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c401134-ffc1-4fac-aa55-ed8f7ef50dbc None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:57.382322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32432c60-82c7-490f-a1ad-6f9f3cb9f1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:57.383457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432c60-82c7-490f-a1ad-6f9f3cb9f1ca None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:57.383869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432c60-82c7-490f-a1ad-6f9f3cb9f1ca None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:57.384278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432c60-82c7-490f-a1ad-6f9f3cb9f1ca None admin] PATH_INFO: `/v3/groups/e6ed59e54fa14d2f87ea45fa8db6f218` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:57.393396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633f226-ea3e-44ed-a589-afff065792c6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:57.394282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32432c60-82c7-490f-a1ad-6f9f3cb9f1ca None admin] RBAC: Authorizing `identity:get_group(group_id=e6ed59e54fa14d2f87ea45fa8db6f218)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:57.395784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32432c60-82c7-490f-a1ad-6f9f3cb9f1ca None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:57.397867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 191/381] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:45:57 2022] GET /identity/v3/groups/e6ed59e54fa14d2f87ea45fa8db6f218 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:57.403869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32432c60-82c7-490f-a1ad-6f9f3cb9f1ca None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:57.433032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2dbc7-73d8-4be2-8c22-71a59220ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:57.434212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2dbc7-73d8-4be2-8c22-71a59220ac35 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:57.434737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2dbc7-73d8-4be2-8c22-71a59220ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:57.435231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2dbc7-73d8-4be2-8c22-71a59220ac35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:57.450921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2dbc7-73d8-4be2-8c22-71a59220ac35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-91f2dbc7-73d8-4be2-8c22-71a59220ac35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:57.467327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:57.468290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:57.469090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:57.471573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 191/382] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:57.477462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2dbc7-73d8-4be2-8c22-71a59220ac35 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:57.524074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32432c60-82c7-490f-a1ad-6f9f3cb9f1ca None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:57.560534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a385b0-1a07-4f56-89fc-863cf689fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:57.561441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a385b0-1a07-4f56-89fc-863cf689fc69 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:57.561973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a385b0-1a07-4f56-89fc-863cf689fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:57.562410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a385b0-1a07-4f56-89fc-863cf689fc69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:57.563441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a385b0-1a07-4f56-89fc-863cf689fc69 None admin] RBAC: Adding query filter params (group.id=e6ed59e54fa14d2f87ea45fa8db6f218, role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=039d8e8cc62f44a2bdf4d5f5334c1312) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:57.563980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a385b0-1a07-4f56-89fc-863cf689fc69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:57.565687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a385b0-1a07-4f56-89fc-863cf689fc69 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:57.571707 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 192/383] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:45:57 2022] GET /identity/v3/role_assignments?group.id=e6ed59e54fa14d2f87ea45fa8db6f218&scope.project.id=039d8e8cc62f44a2bdf4d5f5334c1312&role.id=d03e020b3fb34446bbf5893b28904483 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:57.595579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2dbc7-73d8-4be2-8c22-71a59220ac35 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:57.634442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275b2e4-c0d1-4b82-be41-8037b1824640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:57.635168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275b2e4-c0d1-4b82-be41-8037b1824640 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:57.635455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275b2e4-c0d1-4b82-be41-8037b1824640 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:57.635733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275b2e4-c0d1-4b82-be41-8037b1824640 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:57.636512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275b2e4-c0d1-4b82-be41-8037b1824640 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:57.636888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275b2e4-c0d1-4b82-be41-8037b1824640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:57.638355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275b2e4-c0d1-4b82-be41-8037b1824640 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:57.648336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 192/384] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:57.654565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a385b0-1a07-4f56-89fc-863cf689fc69 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:57.815476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a385b0-1a07-4f56-89fc-863cf689fc69 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:57.857458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e59611-fa09-4f16-870e-cc12a5111585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:57.858574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e59611-fa09-4f16-870e-cc12a5111585 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:57.859027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e59611-fa09-4f16-870e-cc12a5111585 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:57.859444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e59611-fa09-4f16-870e-cc12a5111585 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:57.866268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e59611-fa09-4f16-870e-cc12a5111585 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:57.867951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e59611-fa09-4f16-870e-cc12a5111585 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:57.870220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 193/385] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:45:57 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:57.878632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275b2e4-c0d1-4b82-be41-8037b1824640 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:58.014699 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275b2e4-c0d1-4b82-be41-8037b1824640 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:58.056612 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027dcf8-bc62-472d-8660-04de9d7431e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:58.057515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027dcf8-bc62-472d-8660-04de9d7431e7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:58.057824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027dcf8-bc62-472d-8660-04de9d7431e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:58.058103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027dcf8-bc62-472d-8660-04de9d7431e7 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:58.059314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027dcf8-bc62-472d-8660-04de9d7431e7 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:58.060747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027dcf8-bc62-472d-8660-04de9d7431e7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:58.062776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 193/386] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:57 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:58.070566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e59611-fa09-4f16-870e-cc12a5111585 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:58.224676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e59611-fa09-4f16-870e-cc12a5111585 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:58.264738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6e45c-2be2-4817-b9a5-cfb784b2364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:58.265698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6e45c-2be2-4817-b9a5-cfb784b2364b None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:58.266032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6e45c-2be2-4817-b9a5-cfb784b2364b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:58.266316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6e45c-2be2-4817-b9a5-cfb784b2364b None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340/groups/312887f25def4d1082e95c52181aaab0/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:58.270798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6e45c-2be2-4817-b9a5-cfb784b2364b None admin] RBAC: Authorizing `identity:create_grant(project_id=cb46cdbaf65d4668a7a32126ba096340, group_id=312887f25def4d1082e95c52181aaab0, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:58.272268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6e45c-2be2-4817-b9a5-cfb784b2364b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:58.292211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 194/387] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 12 18:45:58 2022] PUT /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340/groups/312887f25def4d1082e95c52181aaab0/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:45:58.899445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1179-d4a7-4f90-96b9-39e1de6eefb4 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:58.899984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1179-d4a7-4f90-96b9-39e1de6eefb4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:58.899984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1179-d4a7-4f90-96b9-39e1de6eefb4 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:58.902212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 194/388] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:58.919734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e8ee7-c541-48d9-aaf4-d7eaf5b933c9 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:58.920231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e8ee7-c541-48d9-aaf4-d7eaf5b933c9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:58.920334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e8ee7-c541-48d9-aaf4-d7eaf5b933c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:58.942577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-ec0e8ee7-c541-48d9-aaf4-d7eaf5b933c9 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:58.943789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ec0e8ee7-c541-48d9-aaf4-d7eaf5b933c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:59.028694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 195/389] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:45:59.058662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b1179-d4a7-4f90-96b9-39e1de6eefb4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:59.190790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b1179-d4a7-4f90-96b9-39e1de6eefb4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:59.234210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace668f-0330-4848-8701-7eae597e0a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:59.235015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace668f-0330-4848-8701-7eae597e0a65 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:59.235300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace668f-0330-4848-8701-7eae597e0a65 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:59.235576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace668f-0330-4848-8701-7eae597e0a65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:59.250554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace668f-0330-4848-8701-7eae597e0a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-aace668f-0330-4848-8701-7eae597e0a65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:59.258563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:59.259433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:45:59.260788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:59.264555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 195/390] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:45:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:59.271419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e8ee7-c541-48d9-aaf4-d7eaf5b933c9 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:59.337807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337a85d-8cc5-47f1-b5e9-aac5df5c9ed6 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:59.338187 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337a85d-8cc5-47f1-b5e9-aac5df5c9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:59.338409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337a85d-8cc5-47f1-b5e9-aac5df5c9ed6 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:59.345075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 196/391] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:45:59.355304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9d09-a7fe-4a88-be20-cf5cd9e5d668 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:59.355598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9d09-a7fe-4a88-be20-cf5cd9e5d668 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:59.355881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9d09-a7fe-4a88-be20-cf5cd9e5d668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:59.390517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-852a9d09-a7fe-4a88-be20-cf5cd9e5d668 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:45:59.391714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-852a9d09-a7fe-4a88-be20-cf5cd9e5d668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:45:59.394148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e8ee7-c541-48d9-aaf4-d7eaf5b933c9 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:59.433908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5167ecf-5fc6-46c0-a638-696abfbdd53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:59.434939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167ecf-5fc6-46c0-a638-696abfbdd53b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:59.435418 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167ecf-5fc6-46c0-a638-696abfbdd53b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:59.435884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167ecf-5fc6-46c0-a638-696abfbdd53b None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:59.436855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5167ecf-5fc6-46c0-a638-696abfbdd53b None admin] RBAC: Adding query filter params (name=member) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:45:59.437377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5167ecf-5fc6-46c0-a638-696abfbdd53b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:59.438968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5167ecf-5fc6-46c0-a638-696abfbdd53b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:59.449949 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 196/392] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:45:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:59.455868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5167ecf-5fc6-46c0-a638-696abfbdd53b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:59.516665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 197/393] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:45:59.555075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9d09-a7fe-4a88-be20-cf5cd9e5d668 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:59.607819 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5167ecf-5fc6-46c0-a638-696abfbdd53b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:59.655657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159af69b-e070-4479-858f-7f56862bee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:59.655657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af69b-e070-4479-858f-7f56862bee85 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:59.655657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af69b-e070-4479-858f-7f56862bee85 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:59.655657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af69b-e070-4479-858f-7f56862bee85 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:59.656882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159af69b-e070-4479-858f-7f56862bee85 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:59.658386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159af69b-e070-4479-858f-7f56862bee85 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:59.660018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 197/394] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:45:59 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:45:59.665303 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159af69b-e070-4479-858f-7f56862bee85 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:59.685638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9d09-a7fe-4a88-be20-cf5cd9e5d668 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:59.745614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5390a04-dab8-46f2-b641-60507a5ef702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:59.746813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5390a04-dab8-46f2-b641-60507a5ef702 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:59.747294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5390a04-dab8-46f2-b641-60507a5ef702 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:59.747782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5390a04-dab8-46f2-b641-60507a5ef702 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:59.774494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5390a04-dab8-46f2-b641-60507a5ef702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d5390a04-dab8-46f2-b641-60507a5ef702 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:45:59.783676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:45:59.784570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:45:59.785359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:45:59.790536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159af69b-e070-4479-858f-7f56862bee85 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:45:59.792508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 198/395] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:45:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:45:59.798204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5390a04-dab8-46f2-b641-60507a5ef702 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:59.827427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e9b7-085c-434c-b465-597ec1d00d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:45:59.830709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e9b7-085c-434c-b465-597ec1d00d69 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:45:59.831403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e9b7-085c-434c-b465-597ec1d00d69 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:45:59.832191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e9b7-085c-434c-b465-597ec1d00d69 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:45:59.836719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49e9b7-085c-434c-b465-597ec1d00d69 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:45:59.840734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49e9b7-085c-434c-b465-597ec1d00d69 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:45:59.842991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 198/396] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:45:59 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:45:59.851101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e9b7-085c-434c-b465-597ec1d00d69 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:45:59.964939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e9b7-085c-434c-b465-597ec1d00d69 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:00.001735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fd953-c44b-42ef-a184-b5cdc0def181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:00.003406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fd953-c44b-42ef-a184-b5cdc0def181 None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.003691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fd953-c44b-42ef-a184-b5cdc0def181 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.003968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fd953-c44b-42ef-a184-b5cdc0def181 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168/groups/312887f25def4d1082e95c52181aaab0/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.005954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fd953-c44b-42ef-a184-b5cdc0def181 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c9ffaa9059441daacf4f61653c20168, group_id=312887f25def4d1082e95c52181aaab0, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:00.007774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fd953-c44b-42ef-a184-b5cdc0def181 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:00.026656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5390a04-dab8-46f2-b641-60507a5ef702 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:00.030729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 199/397] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 12 18:45:59 2022] PUT /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168/groups/312887f25def4d1082e95c52181aaab0/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:00.071173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa374c-a760-459d-81e7-220e5798de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:00.071867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa374c-a760-459d-81e7-220e5798de41 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.072153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa374c-a760-459d-81e7-220e5798de41 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.072476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa374c-a760-459d-81e7-220e5798de41 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.073853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa374c-a760-459d-81e7-220e5798de41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:00.074171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa374c-a760-459d-81e7-220e5798de41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:00.075574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa374c-a760-459d-81e7-220e5798de41 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:00.090137 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 199/398] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:45:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:00.095874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fd953-c44b-42ef-a184-b5cdc0def181 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:00.222957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fd953-c44b-42ef-a184-b5cdc0def181 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:00.274463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650af5e-d56a-4f35-8405-50173600b95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:00.275263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650af5e-d56a-4f35-8405-50173600b95b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.275545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650af5e-d56a-4f35-8405-50173600b95b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.276065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650af5e-d56a-4f35-8405-50173600b95b None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.277375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650af5e-d56a-4f35-8405-50173600b95b None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:00.278862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650af5e-d56a-4f35-8405-50173600b95b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:00.280857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 200/399] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:46:00 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:00.286418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa374c-a760-459d-81e7-220e5798de41 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:00.409499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa374c-a760-459d-81e7-220e5798de41 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:00.441588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49827e7-43df-4395-8494-4d9449baa3ca None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.441927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49827e7-43df-4395-8494-4d9449baa3ca None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.442157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49827e7-43df-4395-8494-4d9449baa3ca None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.443958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 201/400] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:00.449452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de8fb-5d94-47eb-934f-2436e248edc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:00.449994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc9bc4-ace5-4947-9e64-93de7d3d0b95 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.450304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc9bc4-ace5-4947-9e64-93de7d3d0b95 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.450407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de8fb-5d94-47eb-934f-2436e248edc1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.450578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc9bc4-ace5-4947-9e64-93de7d3d0b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.450681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de8fb-5d94-47eb-934f-2436e248edc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.450882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de8fb-5d94-47eb-934f-2436e248edc1 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.458439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de8fb-5d94-47eb-934f-2436e248edc1 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:00.459917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de8fb-5d94-47eb-934f-2436e248edc1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:00.461739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 200/401] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:46:00 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:00.467430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de8fb-5d94-47eb-934f-2436e248edc1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:00.468723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9bbc9bc4-ace5-4947-9e64-93de7d3d0b95 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:00.469996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9bbc9bc4-ace5-4947-9e64-93de7d3d0b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:00.576429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 202/402] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:46:00.580451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de8fb-5d94-47eb-934f-2436e248edc1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:00.604527 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc9bc4-ace5-4947-9e64-93de7d3d0b95 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:00.619261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe6ca-dc56-4362-8b82-e69c4391b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:00.620186 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe6ca-dc56-4362-8b82-e69c4391b810 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.620472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe6ca-dc56-4362-8b82-e69c4391b810 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.620752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe6ca-dc56-4362-8b82-e69c4391b810 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340/groups/312887f25def4d1082e95c52181aaab0/roles/ee5d57f7c4704b3d907933236c98c2c2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.623381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efe6ca-dc56-4362-8b82-e69c4391b810 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb46cdbaf65d4668a7a32126ba096340, group_id=312887f25def4d1082e95c52181aaab0, role_id=ee5d57f7c4704b3d907933236c98c2c2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:00.624859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efe6ca-dc56-4362-8b82-e69c4391b810 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:00.643894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 201/403] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 12 18:46:00 2022] PUT /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340/groups/312887f25def4d1082e95c52181aaab0/roles/ee5d57f7c4704b3d907933236c98c2c2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:46:00.645336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6c53-a3e9-4bf7-84b1-288f4f0e32c6 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.645654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6c53-a3e9-4bf7-84b1-288f4f0e32c6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.645940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6c53-a3e9-4bf7-84b1-288f4f0e32c6 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.647340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 202/404] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:00.653841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb352c-074f-488d-bd29-ddad19a9e4e0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.654165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb352c-074f-488d-bd29-ddad19a9e4e0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.654417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb352c-074f-488d-bd29-ddad19a9e4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.672817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-97cb352c-074f-488d-bd29-ddad19a9e4e0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:00.674022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-97cb352c-074f-488d-bd29-ddad19a9e4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:00.753960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc9bc4-ace5-4947-9e64-93de7d3d0b95 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:00.755950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 203/405] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:46:00.797785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb352c-074f-488d-bd29-ddad19a9e4e0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:00.801910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa0d5b-e351-4ff4-8242-25ce249078c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:00.805029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa0d5b-e351-4ff4-8242-25ce249078c2 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:00.805314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa0d5b-e351-4ff4-8242-25ce249078c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:00.805620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa0d5b-e351-4ff4-8242-25ce249078c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:00.833686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa0d5b-e351-4ff4-8242-25ce249078c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-03fa0d5b-e351-4ff4-8242-25ce249078c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:00.842656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:00.844880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:00.847644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 203/406] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:00.854324 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa0d5b-e351-4ff4-8242-25ce249078c2 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:00.970712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb352c-074f-488d-bd29-ddad19a9e4e0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.005471 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa0d5b-e351-4ff4-8242-25ce249078c2 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.013866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4bd10-f9a0-49b5-97a0-35cd667f0e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.014670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4bd10-f9a0-49b5-97a0-35cd667f0e7a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.014952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4bd10-f9a0-49b5-97a0-35cd667f0e7a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.015227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4bd10-f9a0-49b5-97a0-35cd667f0e7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.026907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4bd10-f9a0-49b5-97a0-35cd667f0e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-2be4bd10-f9a0-49b5-97a0-35cd667f0e7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:01.034741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:01.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:01.037759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 204/407] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:01.043944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4bd10-f9a0-49b5-97a0-35cd667f0e7a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:01.049096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c79d11-1418-4849-b458-2193093cbdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.049880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c79d11-1418-4849-b458-2193093cbdf6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.050237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c79d11-1418-4849-b458-2193093cbdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.050604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c79d11-1418-4849-b458-2193093cbdf6 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.051440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c79d11-1418-4849-b458-2193093cbdf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:01.051824 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c79d11-1418-4849-b458-2193093cbdf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:01.053279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c79d11-1418-4849-b458-2193093cbdf6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:01.062071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 204/408] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:01.067622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c79d11-1418-4849-b458-2193093cbdf6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:01.148626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4bd10-f9a0-49b5-97a0-35cd667f0e7a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.177569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c79d11-1418-4849-b458-2193093cbdf6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.183854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99094ee-3d75-4bb7-8095-334451afa8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.184535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99094ee-3d75-4bb7-8095-334451afa8cb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.184816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99094ee-3d75-4bb7-8095-334451afa8cb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.185090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99094ee-3d75-4bb7-8095-334451afa8cb None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.185883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99094ee-3d75-4bb7-8095-334451afa8cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:01.186192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99094ee-3d75-4bb7-8095-334451afa8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:01.187696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99094ee-3d75-4bb7-8095-334451afa8cb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:01.197119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 205/409] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:01.203222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99094ee-3d75-4bb7-8095-334451afa8cb None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:01.212194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fdb0-a3e8-46fd-a8ad-e3d567fb9f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.213134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fdb0-a3e8-46fd-a8ad-e3d567fb9f51 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.213937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fdb0-a3e8-46fd-a8ad-e3d567fb9f51 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.214218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fdb0-a3e8-46fd-a8ad-e3d567fb9f51 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.215482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597fdb0-a3e8-46fd-a8ad-e3d567fb9f51 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:01.216958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597fdb0-a3e8-46fd-a8ad-e3d567fb9f51 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:01.219018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 205/410] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:46:01 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:01.227174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fdb0-a3e8-46fd-a8ad-e3d567fb9f51 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:01.311733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99094ee-3d75-4bb7-8095-334451afa8cb None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.328888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fdb0-a3e8-46fd-a8ad-e3d567fb9f51 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.350883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7140b-c0c6-4599-96be-2b32eb186e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.351821 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7140b-c0c6-4599-96be-2b32eb186e44 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.352109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7140b-c0c6-4599-96be-2b32eb186e44 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.352387 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7140b-c0c6-4599-96be-2b32eb186e44 None admin] PATH_INFO: `/v3/groups/e6ed59e54fa14d2f87ea45fa8db6f218` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.353670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7140b-c0c6-4599-96be-2b32eb186e44 None admin] RBAC: Authorizing `identity:get_group(group_id=e6ed59e54fa14d2f87ea45fa8db6f218)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:01.355124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7140b-c0c6-4599-96be-2b32eb186e44 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:01.357083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 206/411] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:46:01 2022] GET /identity/v3/groups/e6ed59e54fa14d2f87ea45fa8db6f218 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:01.362538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7140b-c0c6-4599-96be-2b32eb186e44 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:01.364747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5be503-1ca7-4c9d-9fbf-dec7c0e099e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.365650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be503-1ca7-4c9d-9fbf-dec7c0e099e2 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.365936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be503-1ca7-4c9d-9fbf-dec7c0e099e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.366376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be503-1ca7-4c9d-9fbf-dec7c0e099e2 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.367595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5be503-1ca7-4c9d-9fbf-dec7c0e099e2 None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:01.369066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5be503-1ca7-4c9d-9fbf-dec7c0e099e2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:01.371120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 206/412] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:46:01 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:01.376623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5be503-1ca7-4c9d-9fbf-dec7c0e099e2 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:01.471823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7140b-c0c6-4599-96be-2b32eb186e44 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.478929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5be503-1ca7-4c9d-9fbf-dec7c0e099e2 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.506001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e69c24-1869-457b-8209-c06d17aa6807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.506862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e69c24-1869-457b-8209-c06d17aa6807 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.507143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e69c24-1869-457b-8209-c06d17aa6807 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.507476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e69c24-1869-457b-8209-c06d17aa6807 None admin] PATH_INFO: `/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.508843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e69c24-1869-457b-8209-c06d17aa6807 None admin] RBAC: Authorizing `identity:get_project(project_id=039d8e8cc62f44a2bdf4d5f5334c1312)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:01.513844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e69c24-1869-457b-8209-c06d17aa6807 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:01.513844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 207/413] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:46:01 2022] GET /identity/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:01.514323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117975ed-3603-45f0-8a37-72f2d83646b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.515218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117975ed-3603-45f0-8a37-72f2d83646b6 None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.515829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117975ed-3603-45f0-8a37-72f2d83646b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.515829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117975ed-3603-45f0-8a37-72f2d83646b6 None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168/groups/312887f25def4d1082e95c52181aaab0/roles/ee5d57f7c4704b3d907933236c98c2c2` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.518058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117975ed-3603-45f0-8a37-72f2d83646b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c9ffaa9059441daacf4f61653c20168, group_id=312887f25def4d1082e95c52181aaab0, role_id=ee5d57f7c4704b3d907933236c98c2c2)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:01.519089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806f960-9a58-4577-968f-f8330ad47351 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.519385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806f960-9a58-4577-968f-f8330ad47351 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.519553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117975ed-3603-45f0-8a37-72f2d83646b6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:01.519700 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806f960-9a58-4577-968f-f8330ad47351 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.521301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 208/414] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:01.522055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806f960-9a58-4577-968f-f8330ad47351 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:01.548481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 207/415] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 12 18:46:01 2022] PUT /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168/groups/312887f25def4d1082e95c52181aaab0/roles/ee5d57f7c4704b3d907933236c98c2c2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:01.550431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a7b4a-cc0c-4c31-b08a-8c8f8c0e845f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.550723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a7b4a-cc0c-4c31-b08a-8c8f8c0e845f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.551002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a7b4a-cc0c-4c31-b08a-8c8f8c0e845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.573959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6e6a7b4a-cc0c-4c31-b08a-8c8f8c0e845f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:01.575774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6e6a7b4a-cc0c-4c31-b08a-8c8f8c0e845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:01.640190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806f960-9a58-4577-968f-f8330ad47351 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.661285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 208/416] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:01.677237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe1455-556f-4632-bdc3-f06de88076aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.678410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1455-556f-4632-bdc3-f06de88076aa None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.678864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1455-556f-4632-bdc3-f06de88076aa None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.679284 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1455-556f-4632-bdc3-f06de88076aa None admin] PATH_INFO: `/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312/groups/e6ed59e54fa14d2f87ea45fa8db6f218/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.681402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe1455-556f-4632-bdc3-f06de88076aa None admin] RBAC: Authorizing `identity:create_grant(project_id=039d8e8cc62f44a2bdf4d5f5334c1312, group_id=e6ed59e54fa14d2f87ea45fa8db6f218, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:01.683572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe1455-556f-4632-bdc3-f06de88076aa None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:01.687215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a7b4a-cc0c-4c31-b08a-8c8f8c0e845f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:01.710417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 209/417] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 12 18:46:01 2022] PUT /identity/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312/groups/e6ed59e54fa14d2f87ea45fa8db6f218/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:01.835424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a7b4a-cc0c-4c31-b08a-8c8f8c0e845f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:01.873234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542f48-4d83-4390-8737-40be80292d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:01.874073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542f48-4d83-4390-8737-40be80292d5b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:01.874352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542f48-4d83-4390-8737-40be80292d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:01.874626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542f48-4d83-4390-8737-40be80292d5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:01.887267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9542f48-4d83-4390-8737-40be80292d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-e9542f48-4d83-4390-8737-40be80292d5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:01.895361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:01.896336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:01.897129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 209/418] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:01.903204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe1455-556f-4632-bdc3-f06de88076aa None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:02.013815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe1455-556f-4632-bdc3-f06de88076aa None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:02.050438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd670a8-df6b-4e2f-8cbe-69cd920a0b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:02.051182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd670a8-df6b-4e2f-8cbe-69cd920a0b41 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:02.051441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd670a8-df6b-4e2f-8cbe-69cd920a0b41 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:02.051716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd670a8-df6b-4e2f-8cbe-69cd920a0b41 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:02.052520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd670a8-df6b-4e2f-8cbe-69cd920a0b41 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:02.052830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd670a8-df6b-4e2f-8cbe-69cd920a0b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:02.054229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd670a8-df6b-4e2f-8cbe-69cd920a0b41 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:02.063397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 210/419] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:02.068780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542f48-4d83-4390-8737-40be80292d5b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:02.197154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542f48-4d83-4390-8737-40be80292d5b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:02.243179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e85451-985b-4b58-9e35-082652d6703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:02.243840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e85451-985b-4b58-9e35-082652d6703b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:02.244127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e85451-985b-4b58-9e35-082652d6703b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:02.244447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e85451-985b-4b58-9e35-082652d6703b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:02.325238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e85451-985b-4b58-9e35-082652d6703b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:02.326749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e85451-985b-4b58-9e35-082652d6703b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:02.449361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 210/420] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:02.454682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd670a8-df6b-4e2f-8cbe-69cd920a0b41 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:02.583000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd670a8-df6b-4e2f-8cbe-69cd920a0b41 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:02.625050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02241ac8-1990-4010-909e-00b5842517c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:02.626278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241ac8-1990-4010-909e-00b5842517c2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:02.626813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241ac8-1990-4010-909e-00b5842517c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:02.627297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241ac8-1990-4010-909e-00b5842517c2 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:02.628693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02241ac8-1990-4010-909e-00b5842517c2 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:02.630369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02241ac8-1990-4010-909e-00b5842517c2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:02.632249 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 211/421] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:46:02 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:02.638359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e85451-985b-4b58-9e35-082652d6703b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:02.763289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e85451-985b-4b58-9e35-082652d6703b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:02.807281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69a07-ab8b-4480-bfb4-fc066fc24fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:02.808531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69a07-ab8b-4480-bfb4-fc066fc24fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:02.809010 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69a07-ab8b-4480-bfb4-fc066fc24fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:02.809479 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69a07-ab8b-4480-bfb4-fc066fc24fa8 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:02.810891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69a07-ab8b-4480-bfb4-fc066fc24fa8 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:02.812556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69a07-ab8b-4480-bfb4-fc066fc24fa8 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:02.814396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 211/422] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:46:02 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:02.820124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02241ac8-1990-4010-909e-00b5842517c2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:02.940983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02241ac8-1990-4010-909e-00b5842517c2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:02.980979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15157395-41cd-4157-9a4a-2fbb54955d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:02.982047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15157395-41cd-4157-9a4a-2fbb54955d5f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:02.982532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15157395-41cd-4157-9a4a-2fbb54955d5f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:02.982999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15157395-41cd-4157-9a4a-2fbb54955d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:02.984022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15157395-41cd-4157-9a4a-2fbb54955d5f None admin] RBAC: Adding query filter params (group.id=312887f25def4d1082e95c52181aaab0, role.id=4a765555b657413ea79721175a7191e3, scope.project.id=cb46cdbaf65d4668a7a32126ba096340) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:02.984530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15157395-41cd-4157-9a4a-2fbb54955d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:02.986195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15157395-41cd-4157-9a4a-2fbb54955d5f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:02.992378 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 212/423] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:46:02 2022] GET /identity/v3/role_assignments?group.id=312887f25def4d1082e95c52181aaab0&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=4a765555b657413ea79721175a7191e3 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:03.481268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71f286-c272-4807-9c79-a768907dc077 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:03.482325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71f286-c272-4807-9c79-a768907dc077 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:03.482854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71f286-c272-4807-9c79-a768907dc077 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:03.484658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 212/424] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:03.489572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354fd8-eb8e-4fdf-b572-6e9d124ab4f2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:03.490366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354fd8-eb8e-4fdf-b572-6e9d124ab4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:03.490822 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354fd8-eb8e-4fdf-b572-6e9d124ab4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:03.509471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-db354fd8-eb8e-4fdf-b572-6e9d124ab4f2 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:03.511690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-db354fd8-eb8e-4fdf-b572-6e9d124ab4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:03.562611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c8119-86b4-4aae-94cd-a97a8492a59e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:03.562907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c8119-86b4-4aae-94cd-a97a8492a59e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:03.563174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c8119-86b4-4aae-94cd-a97a8492a59e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:03.565042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 213/425] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:03.577915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629e48-abfd-4450-bcb4-6c289edfe90c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:03.578455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629e48-abfd-4450-bcb4-6c289edfe90c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:03.578899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629e48-abfd-4450-bcb4-6c289edfe90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:03.589613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 213/426] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:03.599475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-cb629e48-abfd-4450-bcb4-6c289edfe90c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:03.600936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-cb629e48-abfd-4450-bcb4-6c289edfe90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:03.612740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db354fd8-eb8e-4fdf-b572-6e9d124ab4f2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:03.681709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 214/427] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:46:03.702104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb629e48-abfd-4450-bcb4-6c289edfe90c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:03.737073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db354fd8-eb8e-4fdf-b572-6e9d124ab4f2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:03.783668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d480a-774e-401b-8e1c-80031db94117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:03.784835 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d480a-774e-401b-8e1c-80031db94117 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:03.785323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d480a-774e-401b-8e1c-80031db94117 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:03.785836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d480a-774e-401b-8e1c-80031db94117 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:03.805378 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d480a-774e-401b-8e1c-80031db94117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-3d5d480a-774e-401b-8e1c-80031db94117 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:03.816415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:03.817333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 18:46:03.818235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:03.821728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 214/428] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:03.822980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb629e48-abfd-4450-bcb4-6c289edfe90c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:03.827017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d480a-774e-401b-8e1c-80031db94117 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:03.866466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672e97b-cd5c-4597-9d84-a19910cdc04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:03.867281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672e97b-cd5c-4597-9d84-a19910cdc04e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:03.867561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672e97b-cd5c-4597-9d84-a19910cdc04e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:03.867832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672e97b-cd5c-4597-9d84-a19910cdc04e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:03.882890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672e97b-cd5c-4597-9d84-a19910cdc04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-c672e97b-cd5c-4597-9d84-a19910cdc04e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:03.893495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:03.894485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:46:03.895333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:03.902998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 215/429] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:03.906903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672e97b-cd5c-4597-9d84-a19910cdc04e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:03.951836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d480a-774e-401b-8e1c-80031db94117 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:03.986717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83aa0e-6af8-4acf-82b8-5b47261e4d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:03.987439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83aa0e-6af8-4acf-82b8-5b47261e4d26 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:03.988063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83aa0e-6af8-4acf-82b8-5b47261e4d26 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:03.988063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83aa0e-6af8-4acf-82b8-5b47261e4d26 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:03.988663 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83aa0e-6af8-4acf-82b8-5b47261e4d26 None admin] RBAC: Adding query filter params (name=member) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:03.988967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83aa0e-6af8-4acf-82b8-5b47261e4d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:03.990645 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83aa0e-6af8-4acf-82b8-5b47261e4d26 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:03.999177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 215/430] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:46:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:04.004819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83aa0e-6af8-4acf-82b8-5b47261e4d26 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.030802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672e97b-cd5c-4597-9d84-a19910cdc04e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:04.066665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb01077-fbcc-4c5c-bbdc-2b95785daf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:04.067683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb01077-fbcc-4c5c-bbdc-2b95785daf6c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.068171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb01077-fbcc-4c5c-bbdc-2b95785daf6c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.068649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb01077-fbcc-4c5c-bbdc-2b95785daf6c None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.069650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb01077-fbcc-4c5c-bbdc-2b95785daf6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:04.070161 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb01077-fbcc-4c5c-bbdc-2b95785daf6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:04.071737 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb01077-fbcc-4c5c-bbdc-2b95785daf6c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:04.085733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 216/431] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:04.087275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb01077-fbcc-4c5c-bbdc-2b95785daf6c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.109964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83aa0e-6af8-4acf-82b8-5b47261e4d26 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:04.152235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95795c06-fa21-4901-9307-997c717842cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:04.152885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795c06-fa21-4901-9307-997c717842cd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.153164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795c06-fa21-4901-9307-997c717842cd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.153436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795c06-fa21-4901-9307-997c717842cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.192463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb01077-fbcc-4c5c-bbdc-2b95785daf6c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:04.233651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92728ac2-97d3-41dc-b6e7-039ba1e0e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:04.234907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92728ac2-97d3-41dc-b6e7-039ba1e0e065 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.235016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95795c06-fa21-4901-9307-997c717842cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:04.235517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92728ac2-97d3-41dc-b6e7-039ba1e0e065 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.236002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92728ac2-97d3-41dc-b6e7-039ba1e0e065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.236449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95795c06-fa21-4901-9307-997c717842cd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:04.321813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92728ac2-97d3-41dc-b6e7-039ba1e0e065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:04.324790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92728ac2-97d3-41dc-b6e7-039ba1e0e065 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:04.350270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 216/432] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:04.358181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95795c06-fa21-4901-9307-997c717842cd None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.437306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 217/433] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:46:04.438650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f148e-4362-491c-93e8-60a8430a8604 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.438936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f148e-4362-491c-93e8-60a8430a8604 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.439208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f148e-4362-491c-93e8-60a8430a8604 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.440598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 218/434] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:04.442721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c8b88-a2ae-4b20-8ee9-1d95a535537e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.443012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c8b88-a2ae-4b20-8ee9-1d95a535537e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.443293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c8b88-a2ae-4b20-8ee9-1d95a535537e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.444536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 219/435] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:04.445231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c8b88-a2ae-4b20-8ee9-1d95a535537e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.462221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95795c06-fa21-4901-9307-997c717842cd None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:04.493673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9fd10-3835-4b66-8ae7-1ba2b5a42d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:04.495036 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9fd10-3835-4b66-8ae7-1ba2b5a42d9a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.495319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9fd10-3835-4b66-8ae7-1ba2b5a42d9a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.495592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9fd10-3835-4b66-8ae7-1ba2b5a42d9a None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.496775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9fd10-3835-4b66-8ae7-1ba2b5a42d9a None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:04.498237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9fd10-3835-4b66-8ae7-1ba2b5a42d9a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:04.499914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 217/436] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:04.501091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9fbb2-3ff1-47c0-aac1-2c015b7db477 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.501386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9fbb2-3ff1-47c0-aac1-2c015b7db477 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.501687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9fbb2-3ff1-47c0-aac1-2c015b7db477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.517675 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c1d9fbb2-3ff1-47c0-aac1-2c015b7db477 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:04.518850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c1d9fbb2-3ff1-47c0-aac1-2c015b7db477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:04.541590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c8b88-a2ae-4b20-8ee9-1d95a535537e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:04.575103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55517b66-d04e-46d5-83aa-350813817949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:04.575875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55517b66-d04e-46d5-83aa-350813817949 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.576154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55517b66-d04e-46d5-83aa-350813817949 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.576431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55517b66-d04e-46d5-83aa-350813817949 None admin] PATH_INFO: `/v3/projects/cb46cdbaf65d4668a7a32126ba096340` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.578040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55517b66-d04e-46d5-83aa-350813817949 None admin] RBAC: Authorizing `identity:get_project(project_id=cb46cdbaf65d4668a7a32126ba096340)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:04.579646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55517b66-d04e-46d5-83aa-350813817949 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:04.581325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 220/437] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/projects/cb46cdbaf65d4668a7a32126ba096340 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:04.582546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192902-3f3b-425e-a52f-e8f6dafe3078 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.582831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192902-3f3b-425e-a52f-e8f6dafe3078 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.583104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192902-3f3b-425e-a52f-e8f6dafe3078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.585182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 218/438] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:04.593810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9fbb2-3ff1-47c0-aac1-2c015b7db477 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.598995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f0192902-3f3b-425e-a52f-e8f6dafe3078 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:04.600172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f0192902-3f3b-425e-a52f-e8f6dafe3078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:04.663208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 221/439] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:04.664031 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0192902-3f3b-425e-a52f-e8f6dafe3078 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.689048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9fbb2-3ff1-47c0-aac1-2c015b7db477 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:04.720911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2237-dd12-4e99-9cf8-012727725566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:04.721781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2237-dd12-4e99-9cf8-012727725566 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.722063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2237-dd12-4e99-9cf8-012727725566 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.722346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2237-dd12-4e99-9cf8-012727725566 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.723507 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced2237-dd12-4e99-9cf8-012727725566 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:04.724926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced2237-dd12-4e99-9cf8-012727725566 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:04.726556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 219/440] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:04.730354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2237-dd12-4e99-9cf8-012727725566 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.757761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0192902-3f3b-425e-a52f-e8f6dafe3078 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:04.789579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431ca2-43b1-46b6-bccc-53e4f6478484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:04.790421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431ca2-43b1-46b6-bccc-53e4f6478484 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.790701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431ca2-43b1-46b6-bccc-53e4f6478484 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.790969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431ca2-43b1-46b6-bccc-53e4f6478484 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.792662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43431ca2-43b1-46b6-bccc-53e4f6478484 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:04.794147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43431ca2-43b1-46b6-bccc-53e4f6478484 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:04.795760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 222/441] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:04.796570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431ca2-43b1-46b6-bccc-53e4f6478484 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.823847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2237-dd12-4e99-9cf8-012727725566 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:04.855557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85763e88-a094-44c5-b591-61f745e95a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:04.856272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85763e88-a094-44c5-b591-61f745e95a15 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.856602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85763e88-a094-44c5-b591-61f745e95a15 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.856880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85763e88-a094-44c5-b591-61f745e95a15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.866561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85763e88-a094-44c5-b591-61f745e95a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-85763e88-a094-44c5-b591-61f745e95a15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:04.874668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:04.875713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 220/442] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:04.876710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85763e88-a094-44c5-b591-61f745e95a15 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.892733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431ca2-43b1-46b6-bccc-53e4f6478484 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:04.928509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637df045-70d6-4f02-b7f8-758793dad1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:04.929295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637df045-70d6-4f02-b7f8-758793dad1d5 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:04.929601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637df045-70d6-4f02-b7f8-758793dad1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:04.929874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637df045-70d6-4f02-b7f8-758793dad1d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:04.940209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637df045-70d6-4f02-b7f8-758793dad1d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-637df045-70d6-4f02-b7f8-758793dad1d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:04.948336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:04.949312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:04.950180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 223/443] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:04.950849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637df045-70d6-4f02-b7f8-758793dad1d5 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:04.974901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85763e88-a094-44c5-b591-61f745e95a15 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.007014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfc222-6b6b-48fe-8298-a4f6dd12bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.007658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfc222-6b6b-48fe-8298-a4f6dd12bb64 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.007943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfc222-6b6b-48fe-8298-a4f6dd12bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.008221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfc222-6b6b-48fe-8298-a4f6dd12bb64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.009068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfc222-6b6b-48fe-8298-a4f6dd12bb64 None admin] RBAC: Adding query filter params (group.id=312887f25def4d1082e95c52181aaab0, role.id=4a765555b657413ea79721175a7191e3, scope.project.id=6c9ffaa9059441daacf4f61653c20168) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:05.009365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfc222-6b6b-48fe-8298-a4f6dd12bb64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.010878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfc222-6b6b-48fe-8298-a4f6dd12bb64 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.016461 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 221/444] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/role_assignments?group.id=312887f25def4d1082e95c52181aaab0&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=4a765555b657413ea79721175a7191e3 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:05.017220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfc222-6b6b-48fe-8298-a4f6dd12bb64 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.051222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637df045-70d6-4f02-b7f8-758793dad1d5 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.089480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ce454-5cd3-4b90-80dc-2930a921f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.090235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ce454-5cd3-4b90-80dc-2930a921f0af None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.090520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ce454-5cd3-4b90-80dc-2930a921f0af None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.090801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ce454-5cd3-4b90-80dc-2930a921f0af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.091675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ce454-5cd3-4b90-80dc-2930a921f0af None admin] RBAC: Adding query filter params (group.id=312887f25def4d1082e95c52181aaab0, role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=cb46cdbaf65d4668a7a32126ba096340) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:05.091991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ce454-5cd3-4b90-80dc-2930a921f0af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.093505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ce454-5cd3-4b90-80dc-2930a921f0af None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.099801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 224/445] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:46:04 2022] GET /identity/v3/role_assignments?group.id=312887f25def4d1082e95c52181aaab0&scope.project.id=cb46cdbaf65d4668a7a32126ba096340&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:05.099801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ce454-5cd3-4b90-80dc-2930a921f0af None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.152640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfc222-6b6b-48fe-8298-a4f6dd12bb64 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.204095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e205b-e714-464d-af9d-bbd3dbf8822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.205148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e205b-e714-464d-af9d-bbd3dbf8822a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.205482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e205b-e714-464d-af9d-bbd3dbf8822a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.205796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e205b-e714-464d-af9d-bbd3dbf8822a None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.206742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e205b-e714-464d-af9d-bbd3dbf8822a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:05.207063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e205b-e714-464d-af9d-bbd3dbf8822a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.209324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e205b-e714-464d-af9d-bbd3dbf8822a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.220859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 222/446] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:05.226804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e205b-e714-464d-af9d-bbd3dbf8822a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.231595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ce454-5cd3-4b90-80dc-2930a921f0af None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.277407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3769f7-baae-41de-883e-1e2ccb7be075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.278122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3769f7-baae-41de-883e-1e2ccb7be075 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.278409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3769f7-baae-41de-883e-1e2ccb7be075 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.278687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3769f7-baae-41de-883e-1e2ccb7be075 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.279443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3769f7-baae-41de-883e-1e2ccb7be075 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:05.279752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3769f7-baae-41de-883e-1e2ccb7be075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.281180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3769f7-baae-41de-883e-1e2ccb7be075 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.292801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 225/447] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:05.300550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3769f7-baae-41de-883e-1e2ccb7be075 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.350459 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e205b-e714-464d-af9d-bbd3dbf8822a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.390460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d6cbf-9009-4d71-adf8-99855a197409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.391053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d6cbf-9009-4d71-adf8-99855a197409 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.391341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d6cbf-9009-4d71-adf8-99855a197409 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.391619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d6cbf-9009-4d71-adf8-99855a197409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.410321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3769f7-baae-41de-883e-1e2ccb7be075 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.454216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926ba8b-cc9f-4434-804b-ad2c703d8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.455846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926ba8b-cc9f-4434-804b-ad2c703d8e71 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.456134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926ba8b-cc9f-4434-804b-ad2c703d8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.456411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926ba8b-cc9f-4434-804b-ad2c703d8e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.474496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d6cbf-9009-4d71-adf8-99855a197409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.475974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d6cbf-9009-4d71-adf8-99855a197409 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.530615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926ba8b-cc9f-4434-804b-ad2c703d8e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.532119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926ba8b-cc9f-4434-804b-ad2c703d8e71 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.591662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 223/448] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:46:05.596678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d6cbf-9009-4d71-adf8-99855a197409 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.637456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 226/449] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:46:05.642951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926ba8b-cc9f-4434-804b-ad2c703d8e71 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.705979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d6cbf-9009-4d71-adf8-99855a197409 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.737253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56e6d-c2e3-4841-9a58-fcb41cf9d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.738120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56e6d-c2e3-4841-9a58-fcb41cf9d54a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.738394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56e6d-c2e3-4841-9a58-fcb41cf9d54a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.738664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56e6d-c2e3-4841-9a58-fcb41cf9d54a None admin] PATH_INFO: `/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.739629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926ba8b-cc9f-4434-804b-ad2c703d8e71 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.739822 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc56e6d-c2e3-4841-9a58-fcb41cf9d54a None admin] RBAC: Authorizing `identity:get_project(project_id=039d8e8cc62f44a2bdf4d5f5334c1312)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.741263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc56e6d-c2e3-4841-9a58-fcb41cf9d54a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.742962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 224/450] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/projects/039d8e8cc62f44a2bdf4d5f5334c1312 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:05.748278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56e6d-c2e3-4841-9a58-fcb41cf9d54a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.772346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da3063-e28a-4ff0-bd1b-9dab4e82e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.773183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da3063-e28a-4ff0-bd1b-9dab4e82e9cd None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.773463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da3063-e28a-4ff0-bd1b-9dab4e82e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.773767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da3063-e28a-4ff0-bd1b-9dab4e82e9cd None admin] PATH_INFO: `/v3/projects/6c9ffaa9059441daacf4f61653c20168` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.774944 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da3063-e28a-4ff0-bd1b-9dab4e82e9cd None admin] RBAC: Authorizing `identity:get_project(project_id=6c9ffaa9059441daacf4f61653c20168)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.776962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da3063-e28a-4ff0-bd1b-9dab4e82e9cd None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.778671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 227/451] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/projects/6c9ffaa9059441daacf4f61653c20168 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:05.783998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da3063-e28a-4ff0-bd1b-9dab4e82e9cd None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.841768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56e6d-c2e3-4841-9a58-fcb41cf9d54a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.872977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225707-943a-4a79-b712-6ad49ae7eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.873855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225707-943a-4a79-b712-6ad49ae7eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.874141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225707-943a-4a79-b712-6ad49ae7eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.874419 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225707-943a-4a79-b712-6ad49ae7eaa6 None admin] PATH_INFO: `/v3/groups/e6ed59e54fa14d2f87ea45fa8db6f218` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.875338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da3063-e28a-4ff0-bd1b-9dab4e82e9cd None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:05.875592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225707-943a-4a79-b712-6ad49ae7eaa6 None admin] RBAC: Authorizing `identity:get_group(group_id=e6ed59e54fa14d2f87ea45fa8db6f218)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.877015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225707-943a-4a79-b712-6ad49ae7eaa6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.878644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 225/452] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/groups/e6ed59e54fa14d2f87ea45fa8db6f218 => generated 229 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:05.884199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225707-943a-4a79-b712-6ad49ae7eaa6 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.908535 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8a802-1621-4b03-a15f-74bc5e9c1938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:05.909318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8a802-1621-4b03-a15f-74bc5e9c1938 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:05.909626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8a802-1621-4b03-a15f-74bc5e9c1938 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:05.909910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8a802-1621-4b03-a15f-74bc5e9c1938 None admin] PATH_INFO: `/v3/groups/312887f25def4d1082e95c52181aaab0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:05.911069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8a802-1621-4b03-a15f-74bc5e9c1938 None admin] RBAC: Authorizing `identity:get_group(group_id=312887f25def4d1082e95c52181aaab0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:05.912486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8a802-1621-4b03-a15f-74bc5e9c1938 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:05.914180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 228/453] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/groups/312887f25def4d1082e95c52181aaab0 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:05.919750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8a802-1621-4b03-a15f-74bc5e9c1938 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:05.982190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225707-943a-4a79-b712-6ad49ae7eaa6 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:06.011569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8a802-1621-4b03-a15f-74bc5e9c1938 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:06.023818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2a1ff-e1fc-4d9f-9bc5-ecffb5318449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:06.024467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a1ff-e1fc-4d9f-9bc5-ecffb5318449 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:06.024753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a1ff-e1fc-4d9f-9bc5-ecffb5318449 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:06.025030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a1ff-e1fc-4d9f-9bc5-ecffb5318449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:06.025918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a1ff-e1fc-4d9f-9bc5-ecffb5318449 None admin] RBAC: Adding query filter params (group.id=e6ed59e54fa14d2f87ea45fa8db6f218, role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=039d8e8cc62f44a2bdf4d5f5334c1312) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:06.026233 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a1ff-e1fc-4d9f-9bc5-ecffb5318449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:06.027678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a1ff-e1fc-4d9f-9bc5-ecffb5318449 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:06.033293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 226/454] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/role_assignments?group.id=e6ed59e54fa14d2f87ea45fa8db6f218&scope.project.id=039d8e8cc62f44a2bdf4d5f5334c1312&role.id=d03e020b3fb34446bbf5893b28904483 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:06.042934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2dc82-d95f-42a2-b108-25861470c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:06.043602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2dc82-d95f-42a2-b108-25861470c9dd None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:06.043882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2dc82-d95f-42a2-b108-25861470c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:06.044150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2dc82-d95f-42a2-b108-25861470c9dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:06.044979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2dc82-d95f-42a2-b108-25861470c9dd None admin] RBAC: Adding query filter params (group.id=312887f25def4d1082e95c52181aaab0, role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=6c9ffaa9059441daacf4f61653c20168) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:06.045283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2dc82-d95f-42a2-b108-25861470c9dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:06.047054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2dc82-d95f-42a2-b108-25861470c9dd None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:06.053767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 229/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 12 18:46:05 2022] GET /identity/v3/role_assignments?group.id=312887f25def4d1082e95c52181aaab0&scope.project.id=6c9ffaa9059441daacf4f61653c20168&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:08.892639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c9c8e-5382-4b82-8f75-b3789306a1aa None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:08.893161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c9c8e-5382-4b82-8f75-b3789306a1aa None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:08.893161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c9c8e-5382-4b82-8f75-b3789306a1aa None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:08.894846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 227/456] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:08.904568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c34eb-7c28-4ff2-8456-a2c99a779b5c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:08.905086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c34eb-7c28-4ff2-8456-a2c99a779b5c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:08.905161 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c34eb-7c28-4ff2-8456-a2c99a779b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:08.930841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-246c34eb-7c28-4ff2-8456-a2c99a779b5c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:08.932672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-246c34eb-7c28-4ff2-8456-a2c99a779b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:09.020395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 230/457] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:09.061330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c9c8e-5382-4b82-8f75-b3789306a1aa None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:09.118178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291001cf-5c05-4781-bcc0-2a14499bd5ca None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.118471 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291001cf-5c05-4781-bcc0-2a14499bd5ca None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.118738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291001cf-5c05-4781-bcc0-2a14499bd5ca None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.120390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 231/458] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:09.139142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34787-a1be-4e00-87f7-cdfbdb2513be None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.139432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34787-a1be-4e00-87f7-cdfbdb2513be None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.139716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34787-a1be-4e00-87f7-cdfbdb2513be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.176946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4cf34787-a1be-4e00-87f7-cdfbdb2513be None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:09.178095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4cf34787-a1be-4e00-87f7-cdfbdb2513be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:09.181308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c9c8e-5382-4b82-8f75-b3789306a1aa None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:09.244039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c801d-51a3-4e76-b1be-babe6eda403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:09.244849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c801d-51a3-4e76-b1be-babe6eda403b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.245134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c801d-51a3-4e76-b1be-babe6eda403b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.245411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c801d-51a3-4e76-b1be-babe6eda403b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.258717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c801d-51a3-4e76-b1be-babe6eda403b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:09.260998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c801d-51a3-4e76-b1be-babe6eda403b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-004c801d-51a3-4e76-b1be-babe6eda403b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:09.282413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:09.283591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:09.284777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:09.284777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:09.284777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:09.284777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:09.284777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 228/460] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:09.285259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1208d-1089-4e65-9648-7ad11a0521c0 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.286907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1208d-1089-4e65-9648-7ad11a0521c0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.286907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1208d-1089-4e65-9648-7ad11a0521c0 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.287341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 229/461] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:09.291821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 232/461] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:46:09.293264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1208d-1089-4e65-9648-7ad11a0521c0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:09.305560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f067d7-5983-406a-9c88-80f63aa05c8f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.305560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f067d7-5983-406a-9c88-80f63aa05c8f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.305560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f067d7-5983-406a-9c88-80f63aa05c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.323371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c7f067d7-5983-406a-9c88-80f63aa05c8f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:09.324537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c7f067d7-5983-406a-9c88-80f63aa05c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:09.401633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 233/462] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:46:09.402718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f067d7-5983-406a-9c88-80f63aa05c8f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:09.437781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1208d-1089-4e65-9648-7ad11a0521c0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:09.472951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee454c-9976-42f7-b49a-a585dccf7144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:09.473630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee454c-9976-42f7-b49a-a585dccf7144 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.473994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee454c-9976-42f7-b49a-a585dccf7144 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.474267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee454c-9976-42f7-b49a-a585dccf7144 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.474982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee454c-9976-42f7-b49a-a585dccf7144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:09.475362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee454c-9976-42f7-b49a-a585dccf7144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:09.476777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee454c-9976-42f7-b49a-a585dccf7144 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:09.487980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 230/463] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:09.488769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee454c-9976-42f7-b49a-a585dccf7144 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:09.526138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f067d7-5983-406a-9c88-80f63aa05c8f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:09.560141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec101d2-355c-44f5-a0a8-8d114480ba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:09.560930 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec101d2-355c-44f5-a0a8-8d114480ba7f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.561215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec101d2-355c-44f5-a0a8-8d114480ba7f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.561490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec101d2-355c-44f5-a0a8-8d114480ba7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.571708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec101d2-355c-44f5-a0a8-8d114480ba7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:09.573776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec101d2-355c-44f5-a0a8-8d114480ba7f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:09.591263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee454c-9976-42f7-b49a-a585dccf7144 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-6ec101d2-355c-44f5-a0a8-8d114480ba7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:09.593673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:09.594619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:09.595519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:09.595519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:09.595519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:09.595519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:09.599976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 234/464] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:09.600985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec101d2-355c-44f5-a0a8-8d114480ba7f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:09.631857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86541a-2698-4536-b2fe-2db996469671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:09.632728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86541a-2698-4536-b2fe-2db996469671 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.633007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86541a-2698-4536-b2fe-2db996469671 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.633324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86541a-2698-4536-b2fe-2db996469671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.645292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86541a-2698-4536-b2fe-2db996469671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:09.646847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86541a-2698-4536-b2fe-2db996469671 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-bf86541a-2698-4536-b2fe-2db996469671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:09.664819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:09.666991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:09.669116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:09.669116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:09.669116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:09.669116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:09.672376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 231/465] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:09.672376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86541a-2698-4536-b2fe-2db996469671 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:09.705807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec101d2-355c-44f5-a0a8-8d114480ba7f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:09.739739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225a7a-cbd4-48a4-836e-fe34218dc4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:09.740410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225a7a-cbd4-48a4-836e-fe34218dc4d9 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.740691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225a7a-cbd4-48a4-836e-fe34218dc4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.740966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225a7a-cbd4-48a4-836e-fe34218dc4d9 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.741700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc225a7a-cbd4-48a4-836e-fe34218dc4d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:09.743165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc225a7a-cbd4-48a4-836e-fe34218dc4d9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:09.765937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 235/466] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:46:09 2022] POST /identity/v3/users => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:09.766968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225a7a-cbd4-48a4-836e-fe34218dc4d9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:09.774783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86541a-2698-4536-b2fe-2db996469671 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:09.814188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8443e-c903-431f-a5e3-5f2ea227fe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:09.815214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8443e-c903-431f-a5e3-5f2ea227fe70 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.815666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8443e-c903-431f-a5e3-5f2ea227fe70 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.816060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8443e-c903-431f-a5e3-5f2ea227fe70 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.816890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8443e-c903-431f-a5e3-5f2ea227fe70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:09.817196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8443e-c903-431f-a5e3-5f2ea227fe70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:09.819364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8443e-c903-431f-a5e3-5f2ea227fe70 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:09.836504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 232/467] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:09.838020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e50606-a5c4-435e-85d4-3ce6f3778c20 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.838355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e50606-a5c4-435e-85d4-3ce6f3778c20 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.838637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e50606-a5c4-435e-85d4-3ce6f3778c20 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.840326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 233/468] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:09.842228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e50606-a5c4-435e-85d4-3ce6f3778c20 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:09.883295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225a7a-cbd4-48a4-836e-fe34218dc4d9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:09.920548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82994ea-9c77-4afd-88c8-a7801c65a7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:09.921330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82994ea-9c77-4afd-88c8-a7801c65a7e5 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.922108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82994ea-9c77-4afd-88c8-a7801c65a7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.922562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82994ea-9c77-4afd-88c8-a7801c65a7e5 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.923504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82994ea-9c77-4afd-88c8-a7801c65a7e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:09.924032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82994ea-9c77-4afd-88c8-a7801c65a7e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:09.925716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82994ea-9c77-4afd-88c8-a7801c65a7e5 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:09.945569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 236/469] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:09.947941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c096-fac2-4914-a65b-35cdeff59a62 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:09.948401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c096-fac2-4914-a65b-35cdeff59a62 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:09.948869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c096-fac2-4914-a65b-35cdeff59a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:09.966984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4251c096-fac2-4914-a65b-35cdeff59a62 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:09.968464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4251c096-fac2-4914-a65b-35cdeff59a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:09.976238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e50606-a5c4-435e-85d4-3ce6f3778c20 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:10.016271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7678a-3fb1-44d0-86c0-bd7b64fc6248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:10.017214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7678a-3fb1-44d0-86c0-bd7b64fc6248 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:10.017664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7678a-3fb1-44d0-86c0-bd7b64fc6248 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:10.018079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7678a-3fb1-44d0-86c0-bd7b64fc6248 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:10.018927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7678a-3fb1-44d0-86c0-bd7b64fc6248 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:10.020510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7678a-3fb1-44d0-86c0-bd7b64fc6248 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:10.045125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 237/470] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:10.046033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251c096-fac2-4914-a65b-35cdeff59a62 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:10.048641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 234/471] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:46:09 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:46:10.082643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7678a-3fb1-44d0-86c0-bd7b64fc6248 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:10.161388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251c096-fac2-4914-a65b-35cdeff59a62 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:10.208311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706df980-7f5c-4f58-a4fb-384fa70b6e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:10.209001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df980-7f5c-4f58-a4fb-384fa70b6e1c None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:10.209281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df980-7f5c-4f58-a4fb-384fa70b6e1c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:10.209575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df980-7f5c-4f58-a4fb-384fa70b6e1c None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:10.210310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706df980-7f5c-4f58-a4fb-384fa70b6e1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:10.211805 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706df980-7f5c-4f58-a4fb-384fa70b6e1c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:10.260376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 238/472] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:46:10 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:10.279857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7678a-3fb1-44d0-86c0-bd7b64fc6248 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:10.295258 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ef598-e701-42ba-bbf8-c60c4d4249ec None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:10.295922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ef598-e701-42ba-bbf8-c60c4d4249ec None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:10.296404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ef598-e701-42ba-bbf8-c60c4d4249ec None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:10.298720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 239/473] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:46:10.304469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840154c5-55a1-4c1c-be5c-38f6b4a19ab4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:10.304976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840154c5-55a1-4c1c-be5c-38f6b4a19ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:10.305451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840154c5-55a1-4c1c-be5c-38f6b4a19ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:10.320505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dcf66-0880-4055-a7ea-6204620d4ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:10.321329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dcf66-0880-4055-a7ea-6204620d4ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:10.321630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dcf66-0880-4055-a7ea-6204620d4ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:10.322116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dcf66-0880-4055-a7ea-6204620d4ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:10.333667 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dcf66-0880-4055-a7ea-6204620d4ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:10.335426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dcf66-0880-4055-a7ea-6204620d4ed1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:10.342545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-840154c5-55a1-4c1c-be5c-38f6b4a19ab4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:10.342545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-840154c5-55a1-4c1c-be5c-38f6b4a19ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5e3dcf66-0880-4055-a7ea-6204620d4ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:10.355320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:10.356268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:10.357451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:10.357451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:10.357451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:10.357451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:10.357451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 235/474] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:10.363659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dcf66-0880-4055-a7ea-6204620d4ed1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:10.425897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 240/475] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:10.463601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840154c5-55a1-4c1c-be5c-38f6b4a19ab4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:10.509767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dcf66-0880-4055-a7ea-6204620d4ed1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:10.550917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b56afd-a8fe-4222-a930-9725dd95529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:10.551809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b56afd-a8fe-4222-a930-9725dd95529c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:10.552464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b56afd-a8fe-4222-a930-9725dd95529c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:10.552933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b56afd-a8fe-4222-a930-9725dd95529c None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:10.553885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b56afd-a8fe-4222-a930-9725dd95529c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:10.554422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b56afd-a8fe-4222-a930-9725dd95529c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:10.556509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b56afd-a8fe-4222-a930-9725dd95529c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:10.572114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 236/476] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:10.577626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b56afd-a8fe-4222-a930-9725dd95529c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:10.605057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840154c5-55a1-4c1c-be5c-38f6b4a19ab4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:10.651059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:10.652124 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:10.652877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:10.653294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:10.654443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:10.655942 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:10.664023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.sql.core [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 18:46:10.664023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 18:46:10.664023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [parameters: {'id': 'a2db826f5ee8416abd530db597c5ed86', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 18:46:10.664023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79834) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application result = self._query(query) May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application conn.query(q) May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application result.read() May 12 18:46:10.686032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return ref.to_dict() May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 18:46:10.687123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application next(self.gen) May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application yield resource May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application next(self.gen) May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.session.rollback() May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.force_reraise() May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise self.value May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application session.commit() May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 18:46:10.688273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._prepare_impl() May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.session.flush() May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._flush(objects) May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application compat.raise_( May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application flush_context.execute() May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rec.execute(self) May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 18:46:10.689416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 18:46:10.690497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application result = self._query(query) May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application conn.query(q) May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application result.read() May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 18:46:10.691505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [parameters: {'id': 'a2db826f5ee8416abd530db597c5ed86', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:10.692478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 18:46:10.693472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:10.697490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 241/477] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 12 18:46:10 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:10.703175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:10.705942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b56afd-a8fe-4222-a930-9725dd95529c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:10.745355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8afbd-dc2d-4d1d-aaae-74332a0f8543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:10.746296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8afbd-dc2d-4d1d-aaae-74332a0f8543 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:10.746717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8afbd-dc2d-4d1d-aaae-74332a0f8543 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:10.747151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8afbd-dc2d-4d1d-aaae-74332a0f8543 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:10.747989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8afbd-dc2d-4d1d-aaae-74332a0f8543 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:10.749610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8afbd-dc2d-4d1d-aaae-74332a0f8543 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:10.772342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 237/478] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:46:10 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:10.876027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f876d-9d04-48d8-866e-c8ae3ba9b2af None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:10.913738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ac034-d97f-46dd-afeb-ebfc12eb3f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:10.914570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ac034-d97f-46dd-afeb-ebfc12eb3f99 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:10.914856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ac034-d97f-46dd-afeb-ebfc12eb3f99 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:10.915133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ac034-d97f-46dd-afeb-ebfc12eb3f99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:10.927524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ac034-d97f-46dd-afeb-ebfc12eb3f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-978ac034-d97f-46dd-afeb-ebfc12eb3f99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:10.935932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:10.936910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:10.937749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 242/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:10.943451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8afbd-dc2d-4d1d-aaae-74332a0f8543 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:11.069765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8afbd-dc2d-4d1d-aaae-74332a0f8543 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:11.104313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a066777-e66e-4886-b6f3-f0130bc1dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:11.105329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a066777-e66e-4886-b6f3-f0130bc1dbcd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:11.105832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a066777-e66e-4886-b6f3-f0130bc1dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:11.106319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a066777-e66e-4886-b6f3-f0130bc1dbcd None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:11.107257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a066777-e66e-4886-b6f3-f0130bc1dbcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:11.107769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a066777-e66e-4886-b6f3-f0130bc1dbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:11.109310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a066777-e66e-4886-b6f3-f0130bc1dbcd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:11.118056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 238/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:12.570283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11fa23-cc17-41f2-9ced-0a2bad0df39e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:12.570841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11fa23-cc17-41f2-9ced-0a2bad0df39e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:12.570841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11fa23-cc17-41f2-9ced-0a2bad0df39e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:12.573107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 243/481] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:12.579255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d2a2-a433-4876-b271-40ec89f8cf09 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:12.579967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d2a2-a433-4876-b271-40ec89f8cf09 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:12.579967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d2a2-a433-4876-b271-40ec89f8cf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:12.603525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f610d2a2-a433-4876-b271-40ec89f8cf09 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:12.604778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f610d2a2-a433-4876-b271-40ec89f8cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:12.699005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 239/482] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:12.734987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11fa23-cc17-41f2-9ced-0a2bad0df39e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:12.841436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11fa23-cc17-41f2-9ced-0a2bad0df39e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:12.874958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1dc2f-5977-4eab-89e4-6cc75b343fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:12.875753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1dc2f-5977-4eab-89e4-6cc75b343fb3 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:12.876036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1dc2f-5977-4eab-89e4-6cc75b343fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:12.876312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1dc2f-5977-4eab-89e4-6cc75b343fb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:12.887250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1dc2f-5977-4eab-89e4-6cc75b343fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-38f1dc2f-5977-4eab-89e4-6cc75b343fb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:12.895090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:12.895953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:12.896767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 244/483] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:12.902543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610d2a2-a433-4876-b271-40ec89f8cf09 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.021478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610d2a2-a433-4876-b271-40ec89f8cf09 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:13.059616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782dc41-21b4-4d05-967f-75d88a94e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:13.060648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782dc41-21b4-4d05-967f-75d88a94e415 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.061121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782dc41-21b4-4d05-967f-75d88a94e415 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.061641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782dc41-21b4-4d05-967f-75d88a94e415 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.062613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782dc41-21b4-4d05-967f-75d88a94e415 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:13.063108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782dc41-21b4-4d05-967f-75d88a94e415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:13.064658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782dc41-21b4-4d05-967f-75d88a94e415 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:13.071059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f63eb-7c7f-42be-b5ba-190389b7dc6e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.071353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f63eb-7c7f-42be-b5ba-190389b7dc6e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.071634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f63eb-7c7f-42be-b5ba-190389b7dc6e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.073351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 245/484] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:13.074929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 240/485] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:13.081626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f63eb-7c7f-42be-b5ba-190389b7dc6e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.083328 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719536-2161-47a6-b8cc-b43e8c29662b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.083841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719536-2161-47a6-b8cc-b43e8c29662b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.084306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719536-2161-47a6-b8cc-b43e8c29662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.101399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-de719536-2161-47a6-b8cc-b43e8c29662b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:13.102884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-de719536-2161-47a6-b8cc-b43e8c29662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:13.182800 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 241/486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:13.205962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719536-2161-47a6-b8cc-b43e8c29662b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.245692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f63eb-7c7f-42be-b5ba-190389b7dc6e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:13.279422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebe80d-a3ff-43d7-a15e-864aecf51758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:13.280218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebe80d-a3ff-43d7-a15e-864aecf51758 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.280498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebe80d-a3ff-43d7-a15e-864aecf51758 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.280813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebe80d-a3ff-43d7-a15e-864aecf51758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.292563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebe80d-a3ff-43d7-a15e-864aecf51758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:13.294077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebe80d-a3ff-43d7-a15e-864aecf51758 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-d0ebe80d-a3ff-43d7-a15e-864aecf51758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:13.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:13.313332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:13.314223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:13.314223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:13.314223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:13.314223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:13.314223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 246/487] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:13.325944 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebe80d-a3ff-43d7-a15e-864aecf51758 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.404054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719536-2161-47a6-b8cc-b43e8c29662b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:13.430972 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebe80d-a3ff-43d7-a15e-864aecf51758 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:13.438823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749b81-ee3e-4ae8-86a9-fcec1f124e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:13.439677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749b81-ee3e-4ae8-86a9-fcec1f124e8c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.439960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749b81-ee3e-4ae8-86a9-fcec1f124e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.440291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749b81-ee3e-4ae8-86a9-fcec1f124e8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.451004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca749b81-ee3e-4ae8-86a9-fcec1f124e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ca749b81-ee3e-4ae8-86a9-fcec1f124e8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:13.458831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:13.459716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:13.460549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 242/488] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:13.461819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b492-c51d-4f10-8103-1de5059fd3e0 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.463510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b492-c51d-4f10-8103-1de5059fd3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.463510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b492-c51d-4f10-8103-1de5059fd3e0 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.465213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 243/489] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:13.470015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ed21c-9a09-456c-86c7-750ba43d4738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:13.471173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ed21c-9a09-456c-86c7-750ba43d4738 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.472675 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2348c-750a-4e8d-ad45-f188be5319ed None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.472933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2348c-750a-4e8d-ad45-f188be5319ed None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.473260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2348c-750a-4e8d-ad45-f188be5319ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.473788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ed21c-9a09-456c-86c7-750ba43d4738 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.474277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ed21c-9a09-456c-86c7-750ba43d4738 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.475452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ed21c-9a09-456c-86c7-750ba43d4738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:13.476021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ed21c-9a09-456c-86c7-750ba43d4738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:13.477760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ed21c-9a09-456c-86c7-750ba43d4738 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:13.491032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5ef2348c-750a-4e8d-ad45-f188be5319ed None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:13.492059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 247/490] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:13.492305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5ef2348c-750a-4e8d-ad45-f188be5319ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:13.493422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ed21c-9a09-456c-86c7-750ba43d4738 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.563770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 244/491] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:13.564705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2348c-750a-4e8d-ad45-f188be5319ed None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.600627 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ed21c-9a09-456c-86c7-750ba43d4738 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:13.639781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5567f9-4eb3-4908-8644-d2e67fe158c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:13.640468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5567f9-4eb3-4908-8644-d2e67fe158c6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.641465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5567f9-4eb3-4908-8644-d2e67fe158c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.641794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5567f9-4eb3-4908-8644-d2e67fe158c6 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.642661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5567f9-4eb3-4908-8644-d2e67fe158c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:13.643418 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5567f9-4eb3-4908-8644-d2e67fe158c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:13.645237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5567f9-4eb3-4908-8644-d2e67fe158c6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:13.657669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 248/492] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:13.658291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5567f9-4eb3-4908-8644-d2e67fe158c6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.669125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2348c-750a-4e8d-ad45-f188be5319ed None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:13.709146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663b6d2-a714-4160-9e19-57954e617a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:13.709992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663b6d2-a714-4160-9e19-57954e617a2d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.710280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663b6d2-a714-4160-9e19-57954e617a2d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.710558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663b6d2-a714-4160-9e19-57954e617a2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.719279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663b6d2-a714-4160-9e19-57954e617a2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:13.720771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663b6d2-a714-4160-9e19-57954e617a2d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-9663b6d2-a714-4160-9e19-57954e617a2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:13.737718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:13.738673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:13.739580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:13.743552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 245/493] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 12 18:46:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:13.744454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663b6d2-a714-4160-9e19-57954e617a2d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.774489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5567f9-4eb3-4908-8644-d2e67fe158c6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:13.809616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec549e7d-14a6-4f1f-a453-9e058468ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:13.810573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec549e7d-14a6-4f1f-a453-9e058468ee9a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.810858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec549e7d-14a6-4f1f-a453-9e058468ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.811135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec549e7d-14a6-4f1f-a453-9e058468ee9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.823825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec549e7d-14a6-4f1f-a453-9e058468ee9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-ec549e7d-14a6-4f1f-a453-9e058468ee9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:13.831534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:13.832443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:13.833247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 249/494] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:13.834492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec549e7d-14a6-4f1f-a453-9e058468ee9a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.847708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663b6d2-a714-4160-9e19-57954e617a2d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:13.880708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ea4e5-2905-4449-aeb7-d51837988db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:13.881789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ea4e5-2905-4449-aeb7-d51837988db7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.882071 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ea4e5-2905-4449-aeb7-d51837988db7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.882347 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ea4e5-2905-4449-aeb7-d51837988db7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.892760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ea4e5-2905-4449-aeb7-d51837988db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:13.894244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ea4e5-2905-4449-aeb7-d51837988db7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-9b3ea4e5-2905-4449-aeb7-d51837988db7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:13.912857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:13.913743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:13.914596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:13.914596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:13.914596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:13.914596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:13.914596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 246/495] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:13.915405 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539015bf-1572-41bb-a5f5-d6d94cea3bae None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.916237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539015bf-1572-41bb-a5f5-d6d94cea3bae None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.916524 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539015bf-1572-41bb-a5f5-d6d94cea3bae None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.917944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 247/496] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:13.918515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539015bf-1572-41bb-a5f5-d6d94cea3bae None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:13.936413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec549e7d-14a6-4f1f-a453-9e058468ee9a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:13.969724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00193e-1ddc-4846-901d-8344a050aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:13.970477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00193e-1ddc-4846-901d-8344a050aec3 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:13.970767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00193e-1ddc-4846-901d-8344a050aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:13.971047 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00193e-1ddc-4846-901d-8344a050aec3 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:13.971887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00193e-1ddc-4846-901d-8344a050aec3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:13.972198 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00193e-1ddc-4846-901d-8344a050aec3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:13.973665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00193e-1ddc-4846-901d-8344a050aec3 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.009789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 250/497] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 12 18:46:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:14.011165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924b13-32c7-44af-ba66-af975d90e408 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.011456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924b13-32c7-44af-ba66-af975d90e408 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.011732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924b13-32c7-44af-ba66-af975d90e408 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.012989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 251/498] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:14.013693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9924b13-32c7-44af-ba66-af975d90e408 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.016071 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539015bf-1572-41bb-a5f5-d6d94cea3bae None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.048604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44050c-682e-4826-9214-4eefa0a66a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.049261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44050c-682e-4826-9214-4eefa0a66a64 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.049567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44050c-682e-4826-9214-4eefa0a66a64 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.049849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44050c-682e-4826-9214-4eefa0a66a64 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.050593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44050c-682e-4826-9214-4eefa0a66a64 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:14.050899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44050c-682e-4826-9214-4eefa0a66a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.052280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44050c-682e-4826-9214-4eefa0a66a64 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.060725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 248/499] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:14.061927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbecd4c-47f8-4bbf-b686-ce26a85eb152 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.062221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbecd4c-47f8-4bbf-b686-ce26a85eb152 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.062548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbecd4c-47f8-4bbf-b686-ce26a85eb152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.077923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1dbecd4c-47f8-4bbf-b686-ce26a85eb152 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:14.079111 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1dbecd4c-47f8-4bbf-b686-ce26a85eb152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:14.109388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9924b13-32c7-44af-ba66-af975d90e408 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.141213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 249/500] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:14.142073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbecd4c-47f8-4bbf-b686-ce26a85eb152 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.145810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9cc57-f934-4eaa-aaff-6634b4ce8e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.146492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9cc57-f934-4eaa-aaff-6634b4ce8e50 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.146747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9cc57-f934-4eaa-aaff-6634b4ce8e50 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.147020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9cc57-f934-4eaa-aaff-6634b4ce8e50 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.147732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9cc57-f934-4eaa-aaff-6634b4ce8e50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:14.148035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9cc57-f934-4eaa-aaff-6634b4ce8e50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.149414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9cc57-f934-4eaa-aaff-6634b4ce8e50 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.161053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 252/501] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:14.162417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96587587-041b-4019-a910-e95c963c5c03 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.162819 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96587587-041b-4019-a910-e95c963c5c03 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.163159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96587587-041b-4019-a910-e95c963c5c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.180916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-96587587-041b-4019-a910-e95c963c5c03 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:14.182170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-96587587-041b-4019-a910-e95c963c5c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:14.237410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbecd4c-47f8-4bbf-b686-ce26a85eb152 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.243304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 253/502] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:14.243985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96587587-041b-4019-a910-e95c963c5c03 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.270926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dad6dc-0a66-486b-b24b-5f1b4c6e28f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.271564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dad6dc-0a66-486b-b24b-5f1b4c6e28f0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.271841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dad6dc-0a66-486b-b24b-5f1b4c6e28f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.272108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dad6dc-0a66-486b-b24b-5f1b4c6e28f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.334705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dad6dc-0a66-486b-b24b-5f1b4c6e28f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.336158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dad6dc-0a66-486b-b24b-5f1b4c6e28f0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.358096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96587587-041b-4019-a910-e95c963c5c03 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.390440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682705-766b-46da-90d6-170001101348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.391211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682705-766b-46da-90d6-170001101348 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.391490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682705-766b-46da-90d6-170001101348 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.391759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682705-766b-46da-90d6-170001101348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.401191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b682705-766b-46da-90d6-170001101348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.402650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b682705-766b-46da-90d6-170001101348 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-3b682705-766b-46da-90d6-170001101348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:14.419254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:14.420239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:14.421246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:14.421246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:14.421246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:14.421246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:14.421246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 254/503] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:14.421246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682705-766b-46da-90d6-170001101348 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.435190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 250/504] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:14.436029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dad6dc-0a66-486b-b24b-5f1b4c6e28f0 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.516808 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682705-766b-46da-90d6-170001101348 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.526826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dad6dc-0a66-486b-b24b-5f1b4c6e28f0 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.548454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb825c7-da27-422c-b59c-daa9cc7adc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.549227 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb825c7-da27-422c-b59c-daa9cc7adc42 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.549507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb825c7-da27-422c-b59c-daa9cc7adc42 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.549804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb825c7-da27-422c-b59c-daa9cc7adc42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.559261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b00530-e53f-472a-a10c-9727466ca608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.560023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b00530-e53f-472a-a10c-9727466ca608 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.560121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb825c7-da27-422c-b59c-daa9cc7adc42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:14.560300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b00530-e53f-472a-a10c-9727466ca608 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.560567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b00530-e53f-472a-a10c-9727466ca608 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.567279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b00530-e53f-472a-a10c-9727466ca608 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-ddb825c7-da27-422c-b59c-daa9cc7adc42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:14.567636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:14.568661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:14.569607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:14.570218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b00530-e53f-472a-a10c-9727466ca608 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.570285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 255/505] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:14.570285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb825c7-da27-422c-b59c-daa9cc7adc42 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e5b00530-e53f-472a-a10c-9727466ca608 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:14.584185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:14.585341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 251/506] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:14.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b00530-e53f-472a-a10c-9727466ca608 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.661812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb825c7-da27-422c-b59c-daa9cc7adc42 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.680233 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b00530-e53f-472a-a10c-9727466ca608 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.694077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31691b40-e793-4b0d-a1f6-ebaee998729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.694846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31691b40-e793-4b0d-a1f6-ebaee998729f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.695125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31691b40-e793-4b0d-a1f6-ebaee998729f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.695396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31691b40-e793-4b0d-a1f6-ebaee998729f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.705408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31691b40-e793-4b0d-a1f6-ebaee998729f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.706877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31691b40-e793-4b0d-a1f6-ebaee998729f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.711587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697192-f3a4-4928-8e8d-2c488d5e2448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.712231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697192-f3a4-4928-8e8d-2c488d5e2448 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.712534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697192-f3a4-4928-8e8d-2c488d5e2448 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.712808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697192-f3a4-4928-8e8d-2c488d5e2448 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.713513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54697192-f3a4-4928-8e8d-2c488d5e2448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:14.713843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54697192-f3a4-4928-8e8d-2c488d5e2448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.715166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54697192-f3a4-4928-8e8d-2c488d5e2448 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-31691b40-e793-4b0d-a1f6-ebaee998729f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:14.723133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:14.724067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:14.724951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:14.724951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:14.724951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:14.724951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:14.724951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 256/507] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:14.725218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31691b40-e793-4b0d-a1f6-ebaee998729f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.725896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 252/508] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:14.726557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697192-f3a4-4928-8e8d-2c488d5e2448 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.819323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697192-f3a4-4928-8e8d-2c488d5e2448 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.822923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31691b40-e793-4b0d-a1f6-ebaee998729f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.849607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941162bc-9790-4f1a-8e8f-9603223cbb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.850256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941162bc-9790-4f1a-8e8f-9603223cbb0d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.850535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941162bc-9790-4f1a-8e8f-9603223cbb0d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.850805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941162bc-9790-4f1a-8e8f-9603223cbb0d None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.851536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941162bc-9790-4f1a-8e8f-9603223cbb0d None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:14.851836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941162bc-9790-4f1a-8e8f-9603223cbb0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.853738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941162bc-9790-4f1a-8e8f-9603223cbb0d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.854099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a181c-b8da-4a70-ae7d-e2edb9e0db2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.854870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a181c-b8da-4a70-ae7d-e2edb9e0db2e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.855144 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a181c-b8da-4a70-ae7d-e2edb9e0db2e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.855414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a181c-b8da-4a70-ae7d-e2edb9e0db2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.861357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 253/509] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:14.862187 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941162bc-9790-4f1a-8e8f-9603223cbb0d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.865515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a181c-b8da-4a70-ae7d-e2edb9e0db2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.866977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a181c-b8da-4a70-ae7d-e2edb9e0db2e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-c58a181c-b8da-4a70-ae7d-e2edb9e0db2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:14.883974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:14.885074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:14.886150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:14.886150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:14.886150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:14.886150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:14.886150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 257/510] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:14.886150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a181c-b8da-4a70-ae7d-e2edb9e0db2e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:14.958131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941162bc-9790-4f1a-8e8f-9603223cbb0d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.977460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a181c-b8da-4a70-ae7d-e2edb9e0db2e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:14.990364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf82325-2e96-4dcf-b552-653b099e9d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:14.991029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf82325-2e96-4dcf-b552-653b099e9d58 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:14.991311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf82325-2e96-4dcf-b552-653b099e9d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:14.991582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf82325-2e96-4dcf-b552-653b099e9d58 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:14.992424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf82325-2e96-4dcf-b552-653b099e9d58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:14.992732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf82325-2e96-4dcf-b552-653b099e9d58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:14.994245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf82325-2e96-4dcf-b552-653b099e9d58 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.011111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e08e-96e1-41c2-a5ef-e97bd00586d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.011771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e08e-96e1-41c2-a5ef-e97bd00586d0 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.012055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e08e-96e1-41c2-a5ef-e97bd00586d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.012333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e08e-96e1-41c2-a5ef-e97bd00586d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.013052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0e08e-96e1-41c2-a5ef-e97bd00586d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:15.013362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0e08e-96e1-41c2-a5ef-e97bd00586d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.014765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0e08e-96e1-41c2-a5ef-e97bd00586d0 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.026712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 258/511] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:15.027346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e08e-96e1-41c2-a5ef-e97bd00586d0 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.031756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 254/512] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 12 18:46:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:15.032595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf82325-2e96-4dcf-b552-653b099e9d58 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.119963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e08e-96e1-41c2-a5ef-e97bd00586d0 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.125020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf82325-2e96-4dcf-b552-653b099e9d58 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.152264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4af2c-8aec-4efa-9048-ea541ca54491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.153049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4af2c-8aec-4efa-9048-ea541ca54491 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.153333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4af2c-8aec-4efa-9048-ea541ca54491 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.153636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4af2c-8aec-4efa-9048-ea541ca54491 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.157089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df70cf0-320c-4f76-8797-7b3702cb35d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.157900 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df70cf0-320c-4f76-8797-7b3702cb35d8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.158183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df70cf0-320c-4f76-8797-7b3702cb35d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.158457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df70cf0-320c-4f76-8797-7b3702cb35d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.160455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4af2c-8aec-4efa-9048-ea541ca54491 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.161929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4af2c-8aec-4efa-9048-ea541ca54491 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.171364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df70cf0-320c-4f76-8797-7b3702cb35d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.173076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df70cf0-320c-4f76-8797-7b3702cb35d8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-92f4af2c-8aec-4efa-9048-ea541ca54491 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:15.178302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:15.179207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:15.180191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 259/513] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:15.180770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4af2c-8aec-4efa-9048-ea541ca54491 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4df70cf0-320c-4f76-8797-7b3702cb35d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:15.191168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:15.192170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:15.198177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:15.198177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:15.198177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:15.198177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:15.198177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 255/514] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:15.198177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df70cf0-320c-4f76-8797-7b3702cb35d8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.277257 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4af2c-8aec-4efa-9048-ea541ca54491 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.286992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df70cf0-320c-4f76-8797-7b3702cb35d8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.310187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355466d0-5d39-4d91-b155-78944905e470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.310844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355466d0-5d39-4d91-b155-78944905e470 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.311124 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355466d0-5d39-4d91-b155-78944905e470 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.311398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355466d0-5d39-4d91-b155-78944905e470 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.312118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355466d0-5d39-4d91-b155-78944905e470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:15.312431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355466d0-5d39-4d91-b155-78944905e470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.313886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355466d0-5d39-4d91-b155-78944905e470 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.320066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf5d31-0cf3-4068-91ea-eaaa7bea7b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.320727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf5d31-0cf3-4068-91ea-eaaa7bea7b2f None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.321076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf5d31-0cf3-4068-91ea-eaaa7bea7b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.321607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf5d31-0cf3-4068-91ea-eaaa7bea7b2f None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.322345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf5d31-0cf3-4068-91ea-eaaa7bea7b2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.323771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf5d31-0cf3-4068-91ea-eaaa7bea7b2f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.326969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 260/515] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:15.327764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355466d0-5d39-4d91-b155-78944905e470 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.344730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 256/516] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:46:15 2022] POST /identity/v3/users => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:15.345818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf5d31-0cf3-4068-91ea-eaaa7bea7b2f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.436240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355466d0-5d39-4d91-b155-78944905e470 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.457677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf5d31-0cf3-4068-91ea-eaaa7bea7b2f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.471029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf3ee8-6c05-4bc6-b21b-d8a391bb51a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.471683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf3ee8-6c05-4bc6-b21b-d8a391bb51a2 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.471961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf3ee8-6c05-4bc6-b21b-d8a391bb51a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.472229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf3ee8-6c05-4bc6-b21b-d8a391bb51a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.493374 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43948a-42a9-417b-b5d5-b193854c740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.494423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43948a-42a9-417b-b5d5-b193854c740a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.494972 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43948a-42a9-417b-b5d5-b193854c740a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.495396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43948a-42a9-417b-b5d5-b193854c740a None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.496767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43948a-42a9-417b-b5d5-b193854c740a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:15.498072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43948a-42a9-417b-b5d5-b193854c740a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.500346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43948a-42a9-417b-b5d5-b193854c740a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.522398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 257/517] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:15.522584 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43948a-42a9-417b-b5d5-b193854c740a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.547766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf3ee8-6c05-4bc6-b21b-d8a391bb51a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.549168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf3ee8-6c05-4bc6-b21b-d8a391bb51a2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.626752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43948a-42a9-417b-b5d5-b193854c740a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.653969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 261/518] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:15.655092 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf3ee8-6c05-4bc6-b21b-d8a391bb51a2 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.663337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa2716-7af1-4260-9f5b-10411bf02d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.663755 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa2716-7af1-4260-9f5b-10411bf02d17 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.664037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa2716-7af1-4260-9f5b-10411bf02d17 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.664313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa2716-7af1-4260-9f5b-10411bf02d17 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.665040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa2716-7af1-4260-9f5b-10411bf02d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:15.665345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa2716-7af1-4260-9f5b-10411bf02d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.667335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa2716-7af1-4260-9f5b-10411bf02d17 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.678630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 258/519] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:15.679495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa2716-7af1-4260-9f5b-10411bf02d17 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.754283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf3ee8-6c05-4bc6-b21b-d8a391bb51a2 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.778684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa2716-7af1-4260-9f5b-10411bf02d17 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.788049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15dfbb-9262-4580-a7fa-3ca8a51cfe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.788830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15dfbb-9262-4580-a7fa-3ca8a51cfe54 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.789109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15dfbb-9262-4580-a7fa-3ca8a51cfe54 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.789378 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15dfbb-9262-4580-a7fa-3ca8a51cfe54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.797221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15dfbb-9262-4580-a7fa-3ca8a51cfe54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.798760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15dfbb-9262-4580-a7fa-3ca8a51cfe54 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.813235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f817ce-5981-4e4a-b5da-8643faac1a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-4d15dfbb-9262-4580-a7fa-3ca8a51cfe54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:15.813552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:15.814413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:15.815261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:15.815261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:15.815261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:15.815261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:15.815261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:15.815261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:15.815261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:15.815261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:15.815684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f817ce-5981-4e4a-b5da-8643faac1a19 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.815684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f817ce-5981-4e4a-b5da-8643faac1a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.815684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f817ce-5981-4e4a-b5da-8643faac1a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.815874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 262/520] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:15.818328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15dfbb-9262-4580-a7fa-3ca8a51cfe54 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.882232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f817ce-5981-4e4a-b5da-8643faac1a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.884057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f817ce-5981-4e4a-b5da-8643faac1a19 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.916297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15dfbb-9262-4580-a7fa-3ca8a51cfe54 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:15.948899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7db38-fe9d-4964-aa96-b443fabcbcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:15.949786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7db38-fe9d-4964-aa96-b443fabcbcf9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:15.949999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7db38-fe9d-4964-aa96-b443fabcbcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:15.950275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7db38-fe9d-4964-aa96-b443fabcbcf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:15.960680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7db38-fe9d-4964-aa96-b443fabcbcf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:15.962163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7db38-fe9d-4964-aa96-b443fabcbcf9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-91f7db38-fe9d-4964-aa96-b443fabcbcf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:15.980192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:15.981475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:15.982689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:15.982689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:15.982689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:15.982689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:15.982912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 259/521] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:15.982912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f817ce-5981-4e4a-b5da-8643faac1a19 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:15.988721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 263/522] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:15.988721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7db38-fe9d-4964-aa96-b443fabcbcf9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.076979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f817ce-5981-4e4a-b5da-8643faac1a19 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.085545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7db38-fe9d-4964-aa96-b443fabcbcf9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.110305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fa5d8-1558-4c2f-a02a-00c721266b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.111101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fa5d8-1558-4c2f-a02a-00c721266b64 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.111383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fa5d8-1558-4c2f-a02a-00c721266b64 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.111659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fa5d8-1558-4c2f-a02a-00c721266b64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.118569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3729-10a3-493e-8e72-11c0e2d20d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.118739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fa5d8-1558-4c2f-a02a-00c721266b64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.119309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3729-10a3-493e-8e72-11c0e2d20d21 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.119594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3729-10a3-493e-8e72-11c0e2d20d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.119867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3729-10a3-493e-8e72-11c0e2d20d21 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.120172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fa5d8-1558-4c2f-a02a-00c721266b64 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.120657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3729-10a3-493e-8e72-11c0e2d20d21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:16.120969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3729-10a3-493e-8e72-11c0e2d20d21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.122436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3729-10a3-493e-8e72-11c0e2d20d21 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-698fa5d8-1558-4c2f-a02a-00c721266b64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:16.135408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:16.136327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:16.137241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 260/523] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:16.139027 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fa5d8-1558-4c2f-a02a-00c721266b64 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.145464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 264/524] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:16.146725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3729-10a3-493e-8e72-11c0e2d20d21 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.235310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fa5d8-1558-4c2f-a02a-00c721266b64 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.246266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3729-10a3-493e-8e72-11c0e2d20d21 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.268030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11820a53-7964-44dc-97fe-b9aec33382d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.268819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11820a53-7964-44dc-97fe-b9aec33382d0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.269100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11820a53-7964-44dc-97fe-b9aec33382d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.269373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11820a53-7964-44dc-97fe-b9aec33382d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.279694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11820a53-7964-44dc-97fe-b9aec33382d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.280665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001eb82-3abb-4dbd-a6e5-d7f6f50908b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.281146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11820a53-7964-44dc-97fe-b9aec33382d0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.281961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001eb82-3abb-4dbd-a6e5-d7f6f50908b2 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.282441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001eb82-3abb-4dbd-a6e5-d7f6f50908b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.282921 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001eb82-3abb-4dbd-a6e5-d7f6f50908b2 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.283824 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001eb82-3abb-4dbd-a6e5-d7f6f50908b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:16.284340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001eb82-3abb-4dbd-a6e5-d7f6f50908b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.285936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001eb82-3abb-4dbd-a6e5-d7f6f50908b2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.297415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 265/525] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-11820a53-7964-44dc-97fe-b9aec33382d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:16.298396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:16.299230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:16.300084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:16.300084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:16.300084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:16.300084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:16.300084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 261/526] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:16.300795 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11820a53-7964-44dc-97fe-b9aec33382d0 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.300987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001eb82-3abb-4dbd-a6e5-d7f6f50908b2 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.397179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001eb82-3abb-4dbd-a6e5-d7f6f50908b2 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.399333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11820a53-7964-44dc-97fe-b9aec33382d0 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.429994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd953537-72a4-46d0-8a88-020168e9ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.430657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953537-72a4-46d0-8a88-020168e9ee24 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.430940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953537-72a4-46d0-8a88-020168e9ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.431243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953537-72a4-46d0-8a88-020168e9ee24 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.432078 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953537-72a4-46d0-8a88-020168e9ee24 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:16.432300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3eb03-ebb8-4188-bf45-d9545e72a3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.432425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953537-72a4-46d0-8a88-020168e9ee24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.432949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3eb03-ebb8-4188-bf45-d9545e72a3e3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.433235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3eb03-ebb8-4188-bf45-d9545e72a3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.433515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3eb03-ebb8-4188-bf45-d9545e72a3e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.433816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953537-72a4-46d0-8a88-020168e9ee24 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.434373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3eb03-ebb8-4188-bf45-d9545e72a3e3 None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=e2e41b41f355446c8462fafcd91c183f) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:16.434687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3eb03-ebb8-4188-bf45-d9545e72a3e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.436112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3eb03-ebb8-4188-bf45-d9545e72a3e3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.449839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 262/527] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/role_assignments?user.id=e2e41b41f355446c8462fafcd91c183f&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:16.449839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3eb03-ebb8-4188-bf45-d9545e72a3e3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.459181 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 266/528] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:16.460203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd953537-72a4-46d0-8a88-020168e9ee24 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.556005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3eb03-ebb8-4188-bf45-d9545e72a3e3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.569119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd953537-72a4-46d0-8a88-020168e9ee24 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.593105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06537acc-2cb5-4771-a573-835c54569da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.593971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06537acc-2cb5-4771-a573-835c54569da5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.594259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06537acc-2cb5-4771-a573-835c54569da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.594537 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06537acc-2cb5-4771-a573-835c54569da5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.602126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06537acc-2cb5-4771-a573-835c54569da5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.604319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06537acc-2cb5-4771-a573-835c54569da5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.607179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ca54f-e1c9-4945-8105-474aa2fcb847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca54f-e1c9-4945-8105-474aa2fcb847 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.608139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca54f-e1c9-4945-8105-474aa2fcb847 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.608414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca54f-e1c9-4945-8105-474aa2fcb847 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.609149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ca54f-e1c9-4945-8105-474aa2fcb847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:16.609454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ca54f-e1c9-4945-8105-474aa2fcb847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.610880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ca54f-e1c9-4945-8105-474aa2fcb847 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-06537acc-2cb5-4771-a573-835c54569da5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:16.620951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:16.621893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:16.622771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:16.622771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:16.622771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:16.622771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:16.622771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:16.622771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:16.622771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:16.622771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:16.622771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 263/529] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:16.623704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06537acc-2cb5-4771-a573-835c54569da5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.628069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 267/530] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:16.628959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ca54f-e1c9-4945-8105-474aa2fcb847 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.726179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06537acc-2cb5-4771-a573-835c54569da5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.733915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ca54f-e1c9-4945-8105-474aa2fcb847 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.761341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c504e9-5c0e-44ab-a950-8eae714dc9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.762372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c504e9-5c0e-44ab-a950-8eae714dc9e9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.762854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c504e9-5c0e-44ab-a950-8eae714dc9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.763328 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c504e9-5c0e-44ab-a950-8eae714dc9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.767801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491f53-72f0-435b-bd90-49d6437e5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.768291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491f53-72f0-435b-bd90-49d6437e5a27 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.768291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491f53-72f0-435b-bd90-49d6437e5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.768590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491f53-72f0-435b-bd90-49d6437e5a27 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.769279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13491f53-72f0-435b-bd90-49d6437e5a27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:16.769614 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13491f53-72f0-435b-bd90-49d6437e5a27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.771036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13491f53-72f0-435b-bd90-49d6437e5a27 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.788480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 268/531] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:16.789354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491f53-72f0-435b-bd90-49d6437e5a27 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.834889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c504e9-5c0e-44ab-a950-8eae714dc9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.837067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c504e9-5c0e-44ab-a950-8eae714dc9e9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.887646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491f53-72f0-435b-bd90-49d6437e5a27 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:16.922273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c64c8-bf8f-45f7-8f16-9236a9374a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:16.923063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c64c8-bf8f-45f7-8f16-9236a9374a5e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:16.923343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c64c8-bf8f-45f7-8f16-9236a9374a5e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:16.923618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c64c8-bf8f-45f7-8f16-9236a9374a5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:16.930575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c64c8-bf8f-45f7-8f16-9236a9374a5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:16.932595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c64c8-bf8f-45f7-8f16-9236a9374a5e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:16.943740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 264/532] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:16.944850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c504e9-5c0e-44ab-a950-8eae714dc9e9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-591c64c8-bf8f-45f7-8f16-9236a9374a5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:16.951230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:16.952097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:16.952940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:16.952940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:16.952940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:16.952940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:16.952940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:16.952940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:16.952940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:16.952940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:16.952940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 269/533] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:16.953938 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c64c8-bf8f-45f7-8f16-9236a9374a5e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:17.057257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c504e9-5c0e-44ab-a950-8eae714dc9e9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:17.060396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c64c8-bf8f-45f7-8f16-9236a9374a5e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:17.091771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150f824-f27f-4d7c-9480-cdf91c5035ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:17.092776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150f824-f27f-4d7c-9480-cdf91c5035ff None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:17.092883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef93c3-0aee-4a00-9245-09a3ce7d3d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:17.093489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150f824-f27f-4d7c-9480-cdf91c5035ff None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:17.093615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef93c3-0aee-4a00-9245-09a3ce7d3d00 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:17.093890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef93c3-0aee-4a00-9245-09a3ce7d3d00 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:17.094166 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef93c3-0aee-4a00-9245-09a3ce7d3d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:17.094515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150f824-f27f-4d7c-9480-cdf91c5035ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:17.095548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150f824-f27f-4d7c-9480-cdf91c5035ff None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=066d62c015e9483e87e4bd64ce8c4df7) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:17.096055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150f824-f27f-4d7c-9480-cdf91c5035ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:17.097718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150f824-f27f-4d7c-9480-cdf91c5035ff None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:17.105093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 265/534] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/role_assignments?user.id=066d62c015e9483e87e4bd64ce8c4df7&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:17.106320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150f824-f27f-4d7c-9480-cdf91c5035ff None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:17.113974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef93c3-0aee-4a00-9245-09a3ce7d3d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:17.115569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef93c3-0aee-4a00-9245-09a3ce7d3d00 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-b9ef93c3-0aee-4a00-9245-09a3ce7d3d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:17.142077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:17.143007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:17.143881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:17.143881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:17.143881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:17.143881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:17.148776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 270/535] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:17.149700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef93c3-0aee-4a00-9245-09a3ce7d3d00 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:17.221005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150f824-f27f-4d7c-9480-cdf91c5035ff None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:17.258300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d6718-7ea1-4f5a-82bc-2d5157489472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:17.259458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6718-7ea1-4f5a-82bc-2d5157489472 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:17.259957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6718-7ea1-4f5a-82bc-2d5157489472 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:17.260432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6718-7ea1-4f5a-82bc-2d5157489472 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:17.261435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d6718-7ea1-4f5a-82bc-2d5157489472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:17.261977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d6718-7ea1-4f5a-82bc-2d5157489472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:17.263758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d6718-7ea1-4f5a-82bc-2d5157489472 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:17.284504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 266/536] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:17.291624 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d6718-7ea1-4f5a-82bc-2d5157489472 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:17.401844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef93c3-0aee-4a00-9245-09a3ce7d3d00 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:17.443098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d6718-7ea1-4f5a-82bc-2d5157489472 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:17.469119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8a27e-6946-482c-9a5e-e180fe1987b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:17.469895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8a27e-6946-482c-9a5e-e180fe1987b4 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:17.470179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8a27e-6946-482c-9a5e-e180fe1987b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:17.470457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8a27e-6946-482c-9a5e-e180fe1987b4 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:17.472800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8a27e-6946-482c-9a5e-e180fe1987b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:17.473119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8a27e-6946-482c-9a5e-e180fe1987b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:17.476190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8a27e-6946-482c-9a5e-e180fe1987b4 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:17.500766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 271/537] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:17.511154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8a27e-6946-482c-9a5e-e180fe1987b4 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:17.526465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7840e-af4a-498e-8196-58036deb9f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:17.527363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7840e-af4a-498e-8196-58036deb9f54 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:17.528679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7840e-af4a-498e-8196-58036deb9f54 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:17.532431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7840e-af4a-498e-8196-58036deb9f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:17.533417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7840e-af4a-498e-8196-58036deb9f54 None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=c25d2d15ebf644b889ab453d1b7ed277) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:17.533767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7840e-af4a-498e-8196-58036deb9f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:17.536679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7840e-af4a-498e-8196-58036deb9f54 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:17.555883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 267/538] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:17 2022] GET /identity/v3/role_assignments?user.id=c25d2d15ebf644b889ab453d1b7ed277&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:17.670750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8a27e-6946-482c-9a5e-e180fe1987b4 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:17.704817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022c8a-4588-4109-b135-bd6b3f3f7bad None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:17.705168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022c8a-4588-4109-b135-bd6b3f3f7bad None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:17.705388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022c8a-4588-4109-b135-bd6b3f3f7bad None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:17.707105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 268/539] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:17.713829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0795d6-f94c-4243-aa84-9ba51ad0f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:17.714020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365f51-b47b-4973-afef-3936767b83cb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:17.714264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365f51-b47b-4973-afef-3936767b83cb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:17.714435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365f51-b47b-4973-afef-3936767b83cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:17.714635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0795d6-f94c-4243-aa84-9ba51ad0f4ea None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:17.714915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0795d6-f94c-4243-aa84-9ba51ad0f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:17.715186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0795d6-f94c-4243-aa84-9ba51ad0f4ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:17.727040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0795d6-f94c-4243-aa84-9ba51ad0f4ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:17.728579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0795d6-f94c-4243-aa84-9ba51ad0f4ea None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:17.745756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8d365f51-b47b-4973-afef-3936767b83cb None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:17.746996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8d365f51-b47b-4973-afef-3936767b83cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-1b0795d6-f94c-4243-aa84-9ba51ad0f4ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:17.757648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:17.758571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:17.759963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:17.759963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:17.759963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:17.759963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:17.759963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:17.759963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:17.759963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:17.759963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:17.759963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 272/540] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:17.766492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0795d6-f94c-4243-aa84-9ba51ad0f4ea None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:17.872037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 269/541] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:46:17.893912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0795d6-f94c-4243-aa84-9ba51ad0f4ea None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:17.896411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d365f51-b47b-4973-afef-3936767b83cb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:17.928453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2320e-c548-42cf-9e1f-4f503817b9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:17.929031 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2320e-c548-42cf-9e1f-4f503817b9fb None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:17.929313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2320e-c548-42cf-9e1f-4f503817b9fb None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:17.929621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2320e-c548-42cf-9e1f-4f503817b9fb None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:17.930406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2320e-c548-42cf-9e1f-4f503817b9fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:17.930715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2320e-c548-42cf-9e1f-4f503817b9fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:17.932680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2320e-c548-42cf-9e1f-4f503817b9fb None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:17.945365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 273/542] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:17.951929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2320e-c548-42cf-9e1f-4f503817b9fb None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:18.063179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2320e-c548-42cf-9e1f-4f503817b9fb None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:18.100685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cd749-96b0-4e37-bf71-fa924c467bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:18.101779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd749-96b0-4e37-bf71-fa924c467bde None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:18.102088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd749-96b0-4e37-bf71-fa924c467bde None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:18.102370 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd749-96b0-4e37-bf71-fa924c467bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:18.104040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cd749-96b0-4e37-bf71-fa924c467bde None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=41938583e61a45398e3e284c70204292) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:18.104583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cd749-96b0-4e37-bf71-fa924c467bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:18.106495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cd749-96b0-4e37-bf71-fa924c467bde None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:18.113358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 274/543] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:17 2022] GET /identity/v3/role_assignments?user.id=41938583e61a45398e3e284c70204292&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:18.134281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d365f51-b47b-4973-afef-3936767b83cb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:18.178100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810bd08-19e7-4708-91d1-4d7306556370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:18.179261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810bd08-19e7-4708-91d1-4d7306556370 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:18.179550 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810bd08-19e7-4708-91d1-4d7306556370 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:18.179826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810bd08-19e7-4708-91d1-4d7306556370 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:18.192371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810bd08-19e7-4708-91d1-4d7306556370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-0810bd08-19e7-4708-91d1-4d7306556370 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:18.200832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:18.201938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:18.203119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 270/544] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:18.208241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cd749-96b0-4e37-bf71-fa924c467bde None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:18.376020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cd749-96b0-4e37-bf71-fa924c467bde None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:18.418224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b5b8d-dc9a-4c56-a084-c250fa44bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:18.418896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b5b8d-dc9a-4c56-a084-c250fa44bb19 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:18.419182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b5b8d-dc9a-4c56-a084-c250fa44bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:18.419465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b5b8d-dc9a-4c56-a084-c250fa44bb19 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:18.420201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b5b8d-dc9a-4c56-a084-c250fa44bb19 None admin] RBAC: Adding query filter params (name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:18.420510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b5b8d-dc9a-4c56-a084-c250fa44bb19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:18.422171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b5b8d-dc9a-4c56-a084-c250fa44bb19 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:18.430755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 275/545] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:18.436326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810bd08-19e7-4708-91d1-4d7306556370 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:18.585593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810bd08-19e7-4708-91d1-4d7306556370 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:18.639546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f16c0-5753-4d8b-8e40-5c28d7d81eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:18.640338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f16c0-5753-4d8b-8e40-5c28d7d81eb1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:18.640622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f16c0-5753-4d8b-8e40-5c28d7d81eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:18.640896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f16c0-5753-4d8b-8e40-5c28d7d81eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:18.653475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f16c0-5753-4d8b-8e40-5c28d7d81eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:18.654963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f16c0-5753-4d8b-8e40-5c28d7d81eb1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4f9f16c0-5753-4d8b-8e40-5c28d7d81eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:18.677131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:18.678049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:18.679606 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:18.679606 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:18.679606 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:18.679606 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:18.679606 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 271/546] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:18.683995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b5b8d-dc9a-4c56-a084-c250fa44bb19 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:18.798666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b5b8d-dc9a-4c56-a084-c250fa44bb19 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:18.852154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c649b8-eeb4-45f2-b7c3-e55fdf524c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:18.852154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c649b8-eeb4-45f2-b7c3-e55fdf524c9e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:18.852154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c649b8-eeb4-45f2-b7c3-e55fdf524c9e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:18.852154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c649b8-eeb4-45f2-b7c3-e55fdf524c9e None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:18.852550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c649b8-eeb4-45f2-b7c3-e55fdf524c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:18.852550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c649b8-eeb4-45f2-b7c3-e55fdf524c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:18.852550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c649b8-eeb4-45f2-b7c3-e55fdf524c9e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:18.868231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 276/547] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:18.873717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f16c0-5753-4d8b-8e40-5c28d7d81eb1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:19.027023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c05f0-2d95-4dfb-ab5e-f5733398095b None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.027522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c05f0-2d95-4dfb-ab5e-f5733398095b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.027522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c05f0-2d95-4dfb-ab5e-f5733398095b None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.029111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 277/548] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:19.029739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f16c0-5753-4d8b-8e40-5c28d7d81eb1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:19.038883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70b65-651e-4b8e-8164-b44461e605e4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.039172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70b65-651e-4b8e-8164-b44461e605e4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.039459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d70b65-651e-4b8e-8164-b44461e605e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.063560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ccb69-ccfe-4489-b398-2845aa61c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:19.064588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccb69-ccfe-4489-b398-2845aa61c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.065041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccb69-ccfe-4489-b398-2845aa61c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.065459 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccb69-ccfe-4489-b398-2845aa61c2e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.069875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d1d70b65-651e-4b8e-8164-b44461e605e4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:19.071186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d1d70b65-651e-4b8e-8164-b44461e605e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:19.079017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ccb69-ccfe-4489-b398-2845aa61c2e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:19.080769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ccb69-ccfe-4489-b398-2845aa61c2e0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-967ccb69-ccfe-4489-b398-2845aa61c2e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:19.095860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:19.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:19.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:19.100276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 272/549] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:19.106761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ccb69-ccfe-4489-b398-2845aa61c2e0 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:19.205217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 278/550] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:19.239624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d70b65-651e-4b8e-8164-b44461e605e4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:19.274242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ccb69-ccfe-4489-b398-2845aa61c2e0 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:19.318261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2beb27-afa8-44d8-bc92-f6eb8dc1da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:19.319259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2beb27-afa8-44d8-bc92-f6eb8dc1da51 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.319823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2beb27-afa8-44d8-bc92-f6eb8dc1da51 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.320109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2beb27-afa8-44d8-bc92-f6eb8dc1da51 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.321120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2beb27-afa8-44d8-bc92-f6eb8dc1da51 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:19.321438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2beb27-afa8-44d8-bc92-f6eb8dc1da51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:19.323445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2beb27-afa8-44d8-bc92-f6eb8dc1da51 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:19.342626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 273/551] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 12 18:46:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:19.348311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2beb27-afa8-44d8-bc92-f6eb8dc1da51 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:19.418796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d70b65-651e-4b8e-8164-b44461e605e4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:19.466235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac80d2-9068-4728-b8f2-fc8849b1d55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:19.467045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac80d2-9068-4728-b8f2-fc8849b1d55b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.467330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac80d2-9068-4728-b8f2-fc8849b1d55b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.467608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac80d2-9068-4728-b8f2-fc8849b1d55b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.485229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2beb27-afa8-44d8-bc92-f6eb8dc1da51 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:19.488560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac80d2-9068-4728-b8f2-fc8849b1d55b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-c5ac80d2-9068-4728-b8f2-fc8849b1d55b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:19.497563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:19.498496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:19.499308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 279/552] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:19.503866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac80d2-9068-4728-b8f2-fc8849b1d55b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:19.550449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a362b-a647-41f1-ab40-5cb47cfb64ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:19.551126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a362b-a647-41f1-ab40-5cb47cfb64ab None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.551409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a362b-a647-41f1-ab40-5cb47cfb64ab None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.551682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a362b-a647-41f1-ab40-5cb47cfb64ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.678609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac80d2-9068-4728-b8f2-fc8849b1d55b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:19.697768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a362b-a647-41f1-ab40-5cb47cfb64ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:19.699252 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a362b-a647-41f1-ab40-5cb47cfb64ab None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:19.743170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad4b62-2906-4038-a584-524426f07e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:19.744364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad4b62-2906-4038-a584-524426f07e58 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.744643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad4b62-2906-4038-a584-524426f07e58 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.744910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad4b62-2906-4038-a584-524426f07e58 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.745682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad4b62-2906-4038-a584-524426f07e58 None admin] RBAC: Adding query filter params (name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:19.745986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad4b62-2906-4038-a584-524426f07e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:19.747425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad4b62-2906-4038-a584-524426f07e58 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:19.757623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 280/553] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:19.758955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35a77-ff07-4b1e-b8d8-35d324cbba97 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.759809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35a77-ff07-4b1e-b8d8-35d324cbba97 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.760097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35a77-ff07-4b1e-b8d8-35d324cbba97 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.761368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 281/554] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:19.762088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d35a77-ff07-4b1e-b8d8-35d324cbba97 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:19.840739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 274/555] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:19.842094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f359f8-e433-4371-a613-806f21ebe17e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.842383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f359f8-e433-4371-a613-806f21ebe17e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.842657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f359f8-e433-4371-a613-806f21ebe17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.859604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-31f359f8-e433-4371-a613-806f21ebe17e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:19.860815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-31f359f8-e433-4371-a613-806f21ebe17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:19.888055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d35a77-ff07-4b1e-b8d8-35d324cbba97 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:19.927697 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f6b0-f53d-4912-a9c9-20300e90c65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:19.928481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f6b0-f53d-4912-a9c9-20300e90c65b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:19.928813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f6b0-f53d-4912-a9c9-20300e90c65b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:19.929034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f6b0-f53d-4912-a9c9-20300e90c65b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:19.942060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019f6b0-f53d-4912-a9c9-20300e90c65b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:19.943552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019f6b0-f53d-4912-a9c9-20300e90c65b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:19.945660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 275/556] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:19.946720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f359f8-e433-4371-a613-806f21ebe17e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-f019f6b0-f53d-4912-a9c9-20300e90c65b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:19.976365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:19.977297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:19.978740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:19.978740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:19.978740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:19.978740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:19.981603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 282/557] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:19.982616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f6b0-f53d-4912-a9c9-20300e90c65b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.075713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f359f8-e433-4371-a613-806f21ebe17e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.107417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f6b0-f53d-4912-a9c9-20300e90c65b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.123158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aebe70-37e0-4803-9221-4219d8610cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.124639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aebe70-37e0-4803-9221-4219d8610cbb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.125147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aebe70-37e0-4803-9221-4219d8610cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.125648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aebe70-37e0-4803-9221-4219d8610cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.139909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aebe70-37e0-4803-9221-4219d8610cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:20.141038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce963f-7ea5-4879-8116-39a37dd6d2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.141471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aebe70-37e0-4803-9221-4219d8610cbb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:20.141903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce963f-7ea5-4879-8116-39a37dd6d2f6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.142142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce963f-7ea5-4879-8116-39a37dd6d2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.142417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce963f-7ea5-4879-8116-39a37dd6d2f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.153059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce963f-7ea5-4879-8116-39a37dd6d2f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-67aebe70-37e0-4803-9221-4219d8610cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:20.160622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:20.161580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:20.166946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:20.166946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:20.166946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:20.166946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-d5ce963f-7ea5-4879-8116-39a37dd6d2f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:20.167172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:20.167960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 283/558] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:20.168755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce963f-7ea5-4879-8116-39a37dd6d2f6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.170544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 276/559] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:20.170544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc9b18-90b2-4572-908f-1de8cf63ee07 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.170544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc9b18-90b2-4572-908f-1de8cf63ee07 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.170544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc9b18-90b2-4572-908f-1de8cf63ee07 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.172834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 277/560] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:20.175065 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc9b18-90b2-4572-908f-1de8cf63ee07 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.270507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce963f-7ea5-4879-8116-39a37dd6d2f6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.273824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc9b18-90b2-4572-908f-1de8cf63ee07 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.305296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ba766-69c0-40c1-8f0a-c3e784658e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.306004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ba766-69c0-40c1-8f0a-c3e784658e8c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.306286 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ba766-69c0-40c1-8f0a-c3e784658e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.306594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ba766-69c0-40c1-8f0a-c3e784658e8c None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.307273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ba766-69c0-40c1-8f0a-c3e784658e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:20.307580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ba766-69c0-40c1-8f0a-c3e784658e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:20.307749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82064ae-a087-491f-8fe6-23e85c389ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.308403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82064ae-a087-491f-8fe6-23e85c389ba5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.308689 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82064ae-a087-491f-8fe6-23e85c389ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.308945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ba766-69c0-40c1-8f0a-c3e784658e8c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:20.309052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82064ae-a087-491f-8fe6-23e85c389ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.309766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82064ae-a087-491f-8fe6-23e85c389ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:20.310077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82064ae-a087-491f-8fe6-23e85c389ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:20.311437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82064ae-a087-491f-8fe6-23e85c389ba5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:20.320685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 284/561] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:20.321498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ba766-69c0-40c1-8f0a-c3e784658e8c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.325719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 278/562] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:20.325719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53a6e1-ccad-4433-b055-7f5a52992d48 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.325719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53a6e1-ccad-4433-b055-7f5a52992d48 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.325719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53a6e1-ccad-4433-b055-7f5a52992d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.342685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6b53a6e1-ccad-4433-b055-7f5a52992d48 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:20.343884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6b53a6e1-ccad-4433-b055-7f5a52992d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:20.408895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 279/563] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:20.409872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53a6e1-ccad-4433-b055-7f5a52992d48 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.438297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ba766-69c0-40c1-8f0a-c3e784658e8c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.480729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d542afa-a891-4992-b292-a0041e71af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.481401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d542afa-a891-4992-b292-a0041e71af95 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.481741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d542afa-a891-4992-b292-a0041e71af95 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.482020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d542afa-a891-4992-b292-a0041e71af95 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.482770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d542afa-a891-4992-b292-a0041e71af95 None admin] RBAC: Adding query filter params (name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:20.483076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d542afa-a891-4992-b292-a0041e71af95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:20.484478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d542afa-a891-4992-b292-a0041e71af95 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:20.497104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 285/564] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:20.497104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d542afa-a891-4992-b292-a0041e71af95 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.505126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53a6e1-ccad-4433-b055-7f5a52992d48 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.539158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a713e-d511-4567-801e-eb97462d5418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.539883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a713e-d511-4567-801e-eb97462d5418 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.540168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a713e-d511-4567-801e-eb97462d5418 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.540471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a713e-d511-4567-801e-eb97462d5418 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.547747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a713e-d511-4567-801e-eb97462d5418 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:20.549213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a713e-d511-4567-801e-eb97462d5418 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ca1a713e-d511-4567-801e-eb97462d5418 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:20.564197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:20.565267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:20.566307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:20.571035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 280/565] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:20.571035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a713e-d511-4567-801e-eb97462d5418 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.598987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d542afa-a891-4992-b292-a0041e71af95 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.637109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d49fc-eeb0-47db-9339-f3601603b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.637928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d49fc-eeb0-47db-9339-f3601603b899 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.638287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d49fc-eeb0-47db-9339-f3601603b899 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.638561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d49fc-eeb0-47db-9339-f3601603b899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.645100 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d49fc-eeb0-47db-9339-f3601603b899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:20.646589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d49fc-eeb0-47db-9339-f3601603b899 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-0d8d49fc-eeb0-47db-9339-f3601603b899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:20.661076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:20.662174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 286/566] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:20.663245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d49fc-eeb0-47db-9339-f3601603b899 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.682581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a713e-d511-4567-801e-eb97462d5418 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.717923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3141ac-da8d-4f52-a973-10a2cb7c881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.718848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3141ac-da8d-4f52-a973-10a2cb7c881b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.719242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3141ac-da8d-4f52-a973-10a2cb7c881b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.719633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3141ac-da8d-4f52-a973-10a2cb7c881b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.729571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3141ac-da8d-4f52-a973-10a2cb7c881b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-6c3141ac-da8d-4f52-a973-10a2cb7c881b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:20.737242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:20.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:20.739475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:20.743185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 281/567] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:20.743898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3141ac-da8d-4f52-a973-10a2cb7c881b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.763376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d49fc-eeb0-47db-9339-f3601603b899 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.799848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220994c7-2f0f-4da7-9f5c-14294b4d062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.800720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220994c7-2f0f-4da7-9f5c-14294b4d062e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.801111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220994c7-2f0f-4da7-9f5c-14294b4d062e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.801483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220994c7-2f0f-4da7-9f5c-14294b4d062e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.811919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220994c7-2f0f-4da7-9f5c-14294b4d062e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:20.813604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220994c7-2f0f-4da7-9f5c-14294b4d062e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-220994c7-2f0f-4da7-9f5c-14294b4d062e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:20.832000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:20.833098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:20.834226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:20.834226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:20.834226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:20.834226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:20.840139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 287/568] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:20.840139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220994c7-2f0f-4da7-9f5c-14294b4d062e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.845465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3141ac-da8d-4f52-a973-10a2cb7c881b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.877756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c76d-e903-495e-b2e7-ffb96daa4031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.878431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c76d-e903-495e-b2e7-ffb96daa4031 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.878719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c76d-e903-495e-b2e7-ffb96daa4031 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.878998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c76d-e903-495e-b2e7-ffb96daa4031 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.879843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c76d-e903-495e-b2e7-ffb96daa4031 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:20.880155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c76d-e903-495e-b2e7-ffb96daa4031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:20.881635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c76d-e903-495e-b2e7-ffb96daa4031 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:20.904193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 282/569] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:20.905067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c76d-e903-495e-b2e7-ffb96daa4031 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:20.933341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220994c7-2f0f-4da7-9f5c-14294b4d062e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:20.965956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb205a-9e2f-477e-8e94-9b8fa58db504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:20.966605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb205a-9e2f-477e-8e94-9b8fa58db504 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:20.966886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb205a-9e2f-477e-8e94-9b8fa58db504 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:20.967159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb205a-9e2f-477e-8e94-9b8fa58db504 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:20.967945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb205a-9e2f-477e-8e94-9b8fa58db504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:20.968244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb205a-9e2f-477e-8e94-9b8fa58db504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:20.969688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb205a-9e2f-477e-8e94-9b8fa58db504 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:20.980668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 288/570] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:20.981443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb205a-9e2f-477e-8e94-9b8fa58db504 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.000216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c76d-e903-495e-b2e7-ffb96daa4031 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.032188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35846296-c57e-43eb-94bc-f39867d4ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.032873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35846296-c57e-43eb-94bc-f39867d4ca2e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.033160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35846296-c57e-43eb-94bc-f39867d4ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.033431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35846296-c57e-43eb-94bc-f39867d4ca2e None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.034209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35846296-c57e-43eb-94bc-f39867d4ca2e None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:21.034515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35846296-c57e-43eb-94bc-f39867d4ca2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.035864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35846296-c57e-43eb-94bc-f39867d4ca2e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.043355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 283/571] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:21.044125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35846296-c57e-43eb-94bc-f39867d4ca2e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.075210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb205a-9e2f-477e-8e94-9b8fa58db504 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.105606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373e456-5469-4c2c-b97a-a76465261de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.106246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373e456-5469-4c2c-b97a-a76465261de6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.106532 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373e456-5469-4c2c-b97a-a76465261de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.106794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373e456-5469-4c2c-b97a-a76465261de6 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.107495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373e456-5469-4c2c-b97a-a76465261de6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:21.108024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373e456-5469-4c2c-b97a-a76465261de6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.109128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373e456-5469-4c2c-b97a-a76465261de6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.120691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 289/572] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:21.126497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e107a-26eb-48dc-b7d6-49488b4c3f67 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.126497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e107a-26eb-48dc-b7d6-49488b4c3f67 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.126497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e107a-26eb-48dc-b7d6-49488b4c3f67 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.126497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 290/573] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:21.126497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e107a-26eb-48dc-b7d6-49488b4c3f67 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.138151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35846296-c57e-43eb-94bc-f39867d4ca2e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.169888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94259-151f-4269-9c9d-7e959383ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.170683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94259-151f-4269-9c9d-7e959383ebce None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.170965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94259-151f-4269-9c9d-7e959383ebce None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.171240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94259-151f-4269-9c9d-7e959383ebce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.182198 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d94259-151f-4269-9c9d-7e959383ebce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.183630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d94259-151f-4269-9c9d-7e959383ebce None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-20d94259-151f-4269-9c9d-7e959383ebce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:21.200383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:21.201420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:21.202603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:21.202603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:21.202603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:21.202603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:21.202603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 284/574] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:21.202603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94259-151f-4269-9c9d-7e959383ebce None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.223666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e107a-26eb-48dc-b7d6-49488b4c3f67 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.255209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb3ca8-47db-46a3-b362-b98bb625280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.255843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb3ca8-47db-46a3-b362-b98bb625280a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.256117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb3ca8-47db-46a3-b362-b98bb625280a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.256383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb3ca8-47db-46a3-b362-b98bb625280a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.257197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb3ca8-47db-46a3-b362-b98bb625280a None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=84eb7224717643288cc61f8e6f901543) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:21.257501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb3ca8-47db-46a3-b362-b98bb625280a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.258933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb3ca8-47db-46a3-b362-b98bb625280a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.264618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 291/575] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/role_assignments?user.id=84eb7224717643288cc61f8e6f901543&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:21.265453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb3ca8-47db-46a3-b362-b98bb625280a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.300473 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94259-151f-4269-9c9d-7e959383ebce None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.335856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bc1f9-bdeb-490c-b781-29399a9a5ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.336701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bc1f9-bdeb-490c-b781-29399a9a5ae8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.337055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bc1f9-bdeb-490c-b781-29399a9a5ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.337434 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bc1f9-bdeb-490c-b781-29399a9a5ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.348793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bc1f9-bdeb-490c-b781-29399a9a5ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.350467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bc1f9-bdeb-490c-b781-29399a9a5ae8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-749bc1f9-bdeb-490c-b781-29399a9a5ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:21.369619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:21.370793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:21.371895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:21.371895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:21.371895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:21.371895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:21.372177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb3ca8-47db-46a3-b362-b98bb625280a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.377319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 285/576] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:21.377319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63d2a5-10e0-42bc-ad21-04ae49be9a41 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.377319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63d2a5-10e0-42bc-ad21-04ae49be9a41 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.377319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63d2a5-10e0-42bc-ad21-04ae49be9a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.394597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5c63d2a5-10e0-42bc-ad21-04ae49be9a41 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:21.395811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5c63d2a5-10e0-42bc-ad21-04ae49be9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:21.413955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f951f-95a2-4729-a56c-c17ee7e290cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.414781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f951f-95a2-4729-a56c-c17ee7e290cf None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.415074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f951f-95a2-4729-a56c-c17ee7e290cf None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.415816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f951f-95a2-4729-a56c-c17ee7e290cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.425286 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f951f-95a2-4729-a56c-c17ee7e290cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.426788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f951f-95a2-4729-a56c-c17ee7e290cf None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-768f951f-95a2-4729-a56c-c17ee7e290cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:21.442121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:21.443141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:21.444085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 292/577] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:21.444670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f951f-95a2-4729-a56c-c17ee7e290cf None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.467567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 286/578] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:21.468488 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63d2a5-10e0-42bc-ad21-04ae49be9a41 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.554290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f951f-95a2-4729-a56c-c17ee7e290cf None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.565849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63d2a5-10e0-42bc-ad21-04ae49be9a41 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.592029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00696ca9-b194-43dd-97ab-42fabb2fe036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.592644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00696ca9-b194-43dd-97ab-42fabb2fe036 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.592931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00696ca9-b194-43dd-97ab-42fabb2fe036 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.593206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00696ca9-b194-43dd-97ab-42fabb2fe036 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.593964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00696ca9-b194-43dd-97ab-42fabb2fe036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:21.594277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00696ca9-b194-43dd-97ab-42fabb2fe036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.595660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00696ca9-b194-43dd-97ab-42fabb2fe036 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.601707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b5bab-0c46-4704-883b-a0ce0f90a948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.602704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b5bab-0c46-4704-883b-a0ce0f90a948 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.603219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b5bab-0c46-4704-883b-a0ce0f90a948 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.603566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b5bab-0c46-4704-883b-a0ce0f90a948 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.604358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b5bab-0c46-4704-883b-a0ce0f90a948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:21.604661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b5bab-0c46-4704-883b-a0ce0f90a948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.606037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b5bab-0c46-4704-883b-a0ce0f90a948 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.608327 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 293/579] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:21.609139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00696ca9-b194-43dd-97ab-42fabb2fe036 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.625769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 287/580] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:21.626637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b5bab-0c46-4704-883b-a0ce0f90a948 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.706996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00696ca9-b194-43dd-97ab-42fabb2fe036 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.724571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b5bab-0c46-4704-883b-a0ce0f90a948 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.739653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d97302-c082-4723-845d-6285a902b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.740316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d97302-c082-4723-845d-6285a902b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.740593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d97302-c082-4723-845d-6285a902b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.740861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d97302-c082-4723-845d-6285a902b2a2 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.741717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d97302-c082-4723-845d-6285a902b2a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:21.742020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d97302-c082-4723-845d-6285a902b2a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.743941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d97302-c082-4723-845d-6285a902b2a2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.760630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc39eea-dbfd-47c7-aaa5-79a808d97816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.761435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39eea-dbfd-47c7-aaa5-79a808d97816 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.761746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39eea-dbfd-47c7-aaa5-79a808d97816 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.762022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39eea-dbfd-47c7-aaa5-79a808d97816 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.763117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 294/581] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:21.763948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d97302-c082-4723-845d-6285a902b2a2 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.773200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc39eea-dbfd-47c7-aaa5-79a808d97816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-9bc39eea-dbfd-47c7-aaa5-79a808d97816 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:21.780993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:21.782106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 288/582] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:21.788047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc39eea-dbfd-47c7-aaa5-79a808d97816 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.873813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d97302-c082-4723-845d-6285a902b2a2 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.878704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc39eea-dbfd-47c7-aaa5-79a808d97816 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:21.906886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc8faa-80f2-4f78-9e3e-20631966caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.907670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc8faa-80f2-4f78-9e3e-20631966caea None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.907941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc8faa-80f2-4f78-9e3e-20631966caea None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.908214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc8faa-80f2-4f78-9e3e-20631966caea None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.911435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cc289-f37d-495c-8fa4-7276abf25e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:21.912295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cc289-f37d-495c-8fa4-7276abf25e9b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:21.912650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cc289-f37d-495c-8fa4-7276abf25e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:21.912999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cc289-f37d-495c-8fa4-7276abf25e9b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:21.914785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc8faa-80f2-4f78-9e3e-20631966caea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.916225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc8faa-80f2-4f78-9e3e-20631966caea None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.920936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cc289-f37d-495c-8fa4-7276abf25e9b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:21.922727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cc289-f37d-495c-8fa4-7276abf25e9b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-39fc8faa-80f2-4f78-9e3e-20631966caea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:21.929890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:21.931507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:21.932621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:21.932621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:21.932621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:21.932621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:21.932621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:21.932621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:21.932621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:21.932621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:21.933829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 295/583] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:21.934773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc8faa-80f2-4f78-9e3e-20631966caea None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-085cc289-f37d-495c-8fa4-7276abf25e9b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:21.939118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:21.940340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:21.941301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 289/584] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:21.941949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cc289-f37d-495c-8fa4-7276abf25e9b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.039928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cc289-f37d-495c-8fa4-7276abf25e9b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.043347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc8faa-80f2-4f78-9e3e-20631966caea None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.073563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573008b-da7f-438d-a5a4-e707d9ffab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.073993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573008b-da7f-438d-a5a4-e707d9ffab4f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.074276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573008b-da7f-438d-a5a4-e707d9ffab4f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.074635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573008b-da7f-438d-a5a4-e707d9ffab4f None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.075294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573008b-da7f-438d-a5a4-e707d9ffab4f None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:22.075600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573008b-da7f-438d-a5a4-e707d9ffab4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.076975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573008b-da7f-438d-a5a4-e707d9ffab4f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.078880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f7da-6789-4795-994e-e2c00aed3887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.079760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f7da-6789-4795-994e-e2c00aed3887 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.080139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f7da-6789-4795-994e-e2c00aed3887 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.080521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f7da-6789-4795-994e-e2c00aed3887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.090035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 290/585] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:22.090035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573008b-da7f-438d-a5a4-e707d9ffab4f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.091544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717f7da-6789-4795-994e-e2c00aed3887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.093083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717f7da-6789-4795-994e-e2c00aed3887 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-4717f7da-6789-4795-994e-e2c00aed3887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:22.110504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:22.112115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:22.117701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:22.117701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:22.117701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:22.117701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:22.117701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 296/586] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:22.117701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f7da-6789-4795-994e-e2c00aed3887 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.198653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573008b-da7f-438d-a5a4-e707d9ffab4f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.217485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f7da-6789-4795-994e-e2c00aed3887 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.231519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f8df4-5484-4907-afbd-b34caa32a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.232316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8df4-5484-4907-afbd-b34caa32a94c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.232602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8df4-5484-4907-afbd-b34caa32a94c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.232880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8df4-5484-4907-afbd-b34caa32a94c None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.233704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f8df4-5484-4907-afbd-b34caa32a94c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:22.234017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f8df4-5484-4907-afbd-b34caa32a94c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.235456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f8df4-5484-4907-afbd-b34caa32a94c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.247869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 291/587] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:22.248505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f8df4-5484-4907-afbd-b34caa32a94c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.255164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585130f1-2e6f-4b1e-8dbe-fad764a27d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.255962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585130f1-2e6f-4b1e-8dbe-fad764a27d7f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.256360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585130f1-2e6f-4b1e-8dbe-fad764a27d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.256730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585130f1-2e6f-4b1e-8dbe-fad764a27d7f None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.257693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585130f1-2e6f-4b1e-8dbe-fad764a27d7f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:22.258100 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585130f1-2e6f-4b1e-8dbe-fad764a27d7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.259659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585130f1-2e6f-4b1e-8dbe-fad764a27d7f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.276353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 297/588] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:22.277263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585130f1-2e6f-4b1e-8dbe-fad764a27d7f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.355041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f8df4-5484-4907-afbd-b34caa32a94c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.375897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585130f1-2e6f-4b1e-8dbe-fad764a27d7f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.391070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b71bf1-0fde-45c8-9903-51e01cc09e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.391942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b71bf1-0fde-45c8-9903-51e01cc09e4f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.392319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b71bf1-0fde-45c8-9903-51e01cc09e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.392687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b71bf1-0fde-45c8-9903-51e01cc09e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.403013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b71bf1-0fde-45c8-9903-51e01cc09e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.404532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b71bf1-0fde-45c8-9903-51e01cc09e4f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.409293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202e89-6fe7-4881-8c96-1c3103862b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.409995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202e89-6fe7-4881-8c96-1c3103862b6f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.410282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202e89-6fe7-4881-8c96-1c3103862b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.410560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202e89-6fe7-4881-8c96-1c3103862b6f None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.411278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93202e89-6fe7-4881-8c96-1c3103862b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:22.411587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93202e89-6fe7-4881-8c96-1c3103862b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.412939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93202e89-6fe7-4881-8c96-1c3103862b6f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-38b71bf1-0fde-45c8-9903-51e01cc09e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:22.423143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:22.424247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:22.425369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:22.425369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:22.425369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:22.425369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:22.432099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 292/589] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:22.432099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b71bf1-0fde-45c8-9903-51e01cc09e4f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.432316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 298/590] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:22.432316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202e89-6fe7-4881-8c96-1c3103862b6f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.528207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202e89-6fe7-4881-8c96-1c3103862b6f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.528642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b71bf1-0fde-45c8-9903-51e01cc09e4f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.561676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8590e0-4ee0-4912-bf32-0cdd8c1f43fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.562491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44bb0d-8df9-4d89-943d-fbd6cc812a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.562639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8590e0-4ee0-4912-bf32-0cdd8c1f43fc None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.562818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8590e0-4ee0-4912-bf32-0cdd8c1f43fc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.563050 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8590e0-4ee0-4912-bf32-0cdd8c1f43fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.564082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44bb0d-8df9-4d89-943d-fbd6cc812a58 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.564573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44bb0d-8df9-4d89-943d-fbd6cc812a58 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.565169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44bb0d-8df9-4d89-943d-fbd6cc812a58 None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/e2e41b41f355446c8462fafcd91c183f/roles/4803c7e1a903431faba9ebef03061c0d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.573432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8590e0-4ee0-4912-bf32-0cdd8c1f43fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.574905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8590e0-4ee0-4912-bf32-0cdd8c1f43fc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.580557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44bb0d-8df9-4d89-943d-fbd6cc812a58 None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=e2e41b41f355446c8462fafcd91c183f, role_id=4803c7e1a903431faba9ebef03061c0d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.582125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44bb0d-8df9-4d89-943d-fbd6cc812a58 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-1e8590e0-4ee0-4912-bf32-0cdd8c1f43fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:22.592655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:22.593576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:22.594490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:22.594490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:22.594490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:22.594490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:22.597253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 293/591] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:46:22 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/e2e41b41f355446c8462fafcd91c183f/roles/4803c7e1a903431faba9ebef03061c0d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:22.598528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 299/592] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:22.598862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44bb0d-8df9-4d89-943d-fbd6cc812a58 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.599445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8590e0-4ee0-4912-bf32-0cdd8c1f43fc None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.706317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44bb0d-8df9-4d89-943d-fbd6cc812a58 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.716338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8590e0-4ee0-4912-bf32-0cdd8c1f43fc None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.743120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badc074-3d8b-4c86-8997-cad8671d774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.744102 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badc074-3d8b-4c86-8997-cad8671d774e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.744242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badc074-3d8b-4c86-8997-cad8671d774e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.744504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badc074-3d8b-4c86-8997-cad8671d774e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.752083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badc074-3d8b-4c86-8997-cad8671d774e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.753604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badc074-3d8b-4c86-8997-cad8671d774e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.756697 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0dcd9-06bd-442e-80a9-a4febb34500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.757690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0dcd9-06bd-442e-80a9-a4febb34500e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.758177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0dcd9-06bd-442e-80a9-a4febb34500e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.758651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0dcd9-06bd-442e-80a9-a4febb34500e None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.760160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0dcd9-06bd-442e-80a9-a4febb34500e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:22.760679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0dcd9-06bd-442e-80a9-a4febb34500e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.762473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0dcd9-06bd-442e-80a9-a4febb34500e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-9badc074-3d8b-4c86-8997-cad8671d774e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:22.768876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:22.769860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:22.770761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:22.770761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:22.770761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:22.770761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:22.770761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:22.770761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:22.770761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:22.770761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:22.770761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 294/593] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:22.771820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badc074-3d8b-4c86-8997-cad8671d774e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.780719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 300/594] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:22.781953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0dcd9-06bd-442e-80a9-a4febb34500e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.879603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badc074-3d8b-4c86-8997-cad8671d774e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.885274 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0dcd9-06bd-442e-80a9-a4febb34500e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:22.914712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af397e87-0bab-4cff-a24d-3a6a6a6ea3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.915414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af397e87-0bab-4cff-a24d-3a6a6a6ea3ae None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.915740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af397e87-0bab-4cff-a24d-3a6a6a6ea3ae None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.916021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af397e87-0bab-4cff-a24d-3a6a6a6ea3ae None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.916757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af397e87-0bab-4cff-a24d-3a6a6a6ea3ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:22.917061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af397e87-0bab-4cff-a24d-3a6a6a6ea3ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.918529 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af397e87-0bab-4cff-a24d-3a6a6a6ea3ae None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.923383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6770de-3be9-46ba-99ba-eaa83ff6093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:22.924337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6770de-3be9-46ba-99ba-eaa83ff6093d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:22.924818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6770de-3be9-46ba-99ba-eaa83ff6093d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:22.925290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6770de-3be9-46ba-99ba-eaa83ff6093d None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:22.926317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6770de-3be9-46ba-99ba-eaa83ff6093d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:22.926858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6770de-3be9-46ba-99ba-eaa83ff6093d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:22.928473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6770de-3be9-46ba-99ba-eaa83ff6093d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:22.931329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 295/595] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:22.936257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af397e87-0bab-4cff-a24d-3a6a6a6ea3ae None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:22.942210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 301/596] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:22.943314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6770de-3be9-46ba-99ba-eaa83ff6093d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.037362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af397e87-0bab-4cff-a24d-3a6a6a6ea3ae None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.044333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6770de-3be9-46ba-99ba-eaa83ff6093d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.072359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2e3c3-fe5a-4c0a-8777-c21444333db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.073212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2e3c3-fe5a-4c0a-8777-c21444333db4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.073502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2e3c3-fe5a-4c0a-8777-c21444333db4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.073890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2e3c3-fe5a-4c0a-8777-c21444333db4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.081038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2461cb3-7be4-4d3d-aa66-c9b960762db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.081204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2e3c3-fe5a-4c0a-8777-c21444333db4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:23.082282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461cb3-7be4-4d3d-aa66-c9b960762db6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.082532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2e3c3-fe5a-4c0a-8777-c21444333db4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:23.083136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461cb3-7be4-4d3d-aa66-c9b960762db6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.083629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461cb3-7be4-4d3d-aa66-c9b960762db6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.091353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2461cb3-7be4-4d3d-aa66-c9b960762db6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:23.093051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2461cb3-7be4-4d3d-aa66-c9b960762db6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-07c2e3c3-fe5a-4c0a-8777-c21444333db4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:23.097794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:23.098736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 18:46:23.099692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:23.103684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 296/597] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:23.104522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2e3c3-fe5a-4c0a-8777-c21444333db4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-a2461cb3-7be4-4d3d-aa66-c9b960762db6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:23.111435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:23.112650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:23.113598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:23.113598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:23.113598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:23.113598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:23.113598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:23.113598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:23.113598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:23.113598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:23.116027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 302/598] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:23.117042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2461cb3-7be4-4d3d-aa66-c9b960762db6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.211048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2e3c3-fe5a-4c0a-8777-c21444333db4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.219028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2461cb3-7be4-4d3d-aa66-c9b960762db6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.245552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596340c-c0a3-4d28-9fc1-821924819e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.246448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596340c-c0a3-4d28-9fc1-821924819e75 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.246733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596340c-c0a3-4d28-9fc1-821924819e75 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.247010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596340c-c0a3-4d28-9fc1-821924819e75 None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/066d62c015e9483e87e4bd64ce8c4df7/roles/4803c7e1a903431faba9ebef03061c0d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.255408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a73b87-d751-4642-b9cd-4cd85dc0180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.256359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a73b87-d751-4642-b9cd-4cd85dc0180f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.256882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a73b87-d751-4642-b9cd-4cd85dc0180f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.257356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a73b87-d751-4642-b9cd-4cd85dc0180f None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.258411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a73b87-d751-4642-b9cd-4cd85dc0180f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:23.258978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a73b87-d751-4642-b9cd-4cd85dc0180f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:23.261261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a73b87-d751-4642-b9cd-4cd85dc0180f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:23.262319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596340c-c0a3-4d28-9fc1-821924819e75 None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=066d62c015e9483e87e4bd64ce8c4df7, role_id=4803c7e1a903431faba9ebef03061c0d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:23.263749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596340c-c0a3-4d28-9fc1-821924819e75 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:23.278952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 297/599] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:46:23 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/066d62c015e9483e87e4bd64ce8c4df7/roles/4803c7e1a903431faba9ebef03061c0d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:23.279843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596340c-c0a3-4d28-9fc1-821924819e75 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.282997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 303/600] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 12 18:46:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:23.288826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a73b87-d751-4642-b9cd-4cd85dc0180f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.392025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596340c-c0a3-4d28-9fc1-821924819e75 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.406528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a73b87-d751-4642-b9cd-4cd85dc0180f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.430528 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd720e1-efc8-4b7f-a1a8-803472ad812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.430774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd720e1-efc8-4b7f-a1a8-803472ad812f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.431042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd720e1-efc8-4b7f-a1a8-803472ad812f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.431267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd720e1-efc8-4b7f-a1a8-803472ad812f None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.432056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd720e1-efc8-4b7f-a1a8-803472ad812f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:23.432367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd720e1-efc8-4b7f-a1a8-803472ad812f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:23.433841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd720e1-efc8-4b7f-a1a8-803472ad812f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:23.446537 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 298/601] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:23.447180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d22ea-82b6-4f5d-affc-33cf7e46aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.448210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d22ea-82b6-4f5d-affc-33cf7e46aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.448729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d22ea-82b6-4f5d-affc-33cf7e46aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.449254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d22ea-82b6-4f5d-affc-33cf7e46aeb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.452296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd720e1-efc8-4b7f-a1a8-803472ad812f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.466534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d22ea-82b6-4f5d-affc-33cf7e46aeb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:23.469095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d22ea-82b6-4f5d-affc-33cf7e46aeb4 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-465d22ea-82b6-4f5d-affc-33cf7e46aeb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:23.493662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:23.494620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:23.495604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:23.495604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:23.495604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:23.495604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:23.498328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 304/602] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:23.507188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98fab-782b-45f6-b4e8-4fd90588c715 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.507745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98fab-782b-45f6-b4e8-4fd90588c715 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.508169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98fab-782b-45f6-b4e8-4fd90588c715 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.510600 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 305/603] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:23.511489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98fab-782b-45f6-b4e8-4fd90588c715 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.577431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd720e1-efc8-4b7f-a1a8-803472ad812f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.620762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a44bb-f215-4e5c-ad57-7689135adeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.622045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a44bb-f215-4e5c-ad57-7689135adeb5 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.622327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a44bb-f215-4e5c-ad57-7689135adeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.622599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a44bb-f215-4e5c-ad57-7689135adeb5 None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/c25d2d15ebf644b889ab453d1b7ed277/roles/4803c7e1a903431faba9ebef03061c0d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.639379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a44bb-f215-4e5c-ad57-7689135adeb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=c25d2d15ebf644b889ab453d1b7ed277, role_id=4803c7e1a903431faba9ebef03061c0d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:23.640828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a44bb-f215-4e5c-ad57-7689135adeb5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:23.641642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98fab-782b-45f6-b4e8-4fd90588c715 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.654778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 299/604] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:46:23 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/c25d2d15ebf644b889ab453d1b7ed277/roles/4803c7e1a903431faba9ebef03061c0d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:46:23.657277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4603c82-ce59-493f-822f-6a1beb983268 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.657806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4603c82-ce59-493f-822f-6a1beb983268 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.658316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4603c82-ce59-493f-822f-6a1beb983268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.681742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e4603c82-ce59-493f-822f-6a1beb983268 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:23.683701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e4603c82-ce59-493f-822f-6a1beb983268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:23.727623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002aaf-0f36-4933-94c8-69b4c58652b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.728356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002aaf-0f36-4933-94c8-69b4c58652b9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.728637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002aaf-0f36-4933-94c8-69b4c58652b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.728904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002aaf-0f36-4933-94c8-69b4c58652b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.729656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002aaf-0f36-4933-94c8-69b4c58652b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:23.729962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002aaf-0f36-4933-94c8-69b4c58652b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:23.731330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002aaf-0f36-4933-94c8-69b4c58652b9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:23.752159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 306/605] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:23.763217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 300/606] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:23.764585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002aaf-0f36-4933-94c8-69b4c58652b9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.798339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4603c82-ce59-493f-822f-6a1beb983268 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.905489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4603c82-ce59-493f-822f-6a1beb983268 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.922435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002aaf-0f36-4933-94c8-69b4c58652b9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:23.944841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3fbe2-fe88-4a8f-8b3d-260f5e6e4489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.945689 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3fbe2-fe88-4a8f-8b3d-260f5e6e4489 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.945976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3fbe2-fe88-4a8f-8b3d-260f5e6e4489 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.946249 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3fbe2-fe88-4a8f-8b3d-260f5e6e4489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.957854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3fbe2-fe88-4a8f-8b3d-260f5e6e4489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:23.959033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9b517-bb02-40d0-a898-0d613cecda6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:23.959823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9b517-bb02-40d0-a898-0d613cecda6c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:23.960102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9b517-bb02-40d0-a898-0d613cecda6c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:23.961554 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9b517-bb02-40d0-a898-0d613cecda6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d1b3fbe2-fe88-4a8f-8b3d-260f5e6e4489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:23.966273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:23.967230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:23.968089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:23.968754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9b517-bb02-40d0-a898-0d613cecda6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:23.968827 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 301/607] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:23.968895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9b517-bb02-40d0-a898-0d613cecda6c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:23.975326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3fbe2-fe88-4a8f-8b3d-260f5e6e4489 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-9de9b517-bb02-40d0-a898-0d613cecda6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:23.989589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:23.992021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:23.993203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:23.993203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:23.993203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:23.993203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:23.993203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:23.993203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:23.993203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:23.993203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:23.993203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 307/608] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:24.002631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9b517-bb02-40d0-a898-0d613cecda6c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:24.169933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3fbe2-fe88-4a8f-8b3d-260f5e6e4489 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:24.188202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9b517-bb02-40d0-a898-0d613cecda6c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:24.235598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba668-d9c5-4708-97b9-49acbbd38f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:24.236266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba668-d9c5-4708-97b9-49acbbd38f83 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:24.236547 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba668-d9c5-4708-97b9-49acbbd38f83 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:24.236819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba668-d9c5-4708-97b9-49acbbd38f83 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:24.237589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ba668-d9c5-4708-97b9-49acbbd38f83 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:24.237899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ba668-d9c5-4708-97b9-49acbbd38f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:24.239264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ba668-d9c5-4708-97b9-49acbbd38f83 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:24.254665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45820564-8266-407e-a6d8-a625b93e3076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:24.255322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820564-8266-407e-a6d8-a625b93e3076 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:24.255603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820564-8266-407e-a6d8-a625b93e3076 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:24.255876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820564-8266-407e-a6d8-a625b93e3076 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:24.256659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45820564-8266-407e-a6d8-a625b93e3076 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:24.256965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45820564-8266-407e-a6d8-a625b93e3076 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:24.258459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45820564-8266-407e-a6d8-a625b93e3076 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:24.258746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 302/609] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:24.269272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba668-d9c5-4708-97b9-49acbbd38f83 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:24.272670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 308/610] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:24.278104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45820564-8266-407e-a6d8-a625b93e3076 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:24.459430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45820564-8266-407e-a6d8-a625b93e3076 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:24.463596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba668-d9c5-4708-97b9-49acbbd38f83 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:24.499418 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293640b-8cbe-4aff-b4c7-29f29a4b130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:24.500622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293640b-8cbe-4aff-b4c7-29f29a4b130a None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:24.501098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293640b-8cbe-4aff-b4c7-29f29a4b130a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:24.501586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293640b-8cbe-4aff-b4c7-29f29a4b130a None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/41938583e61a45398e3e284c70204292/roles/4803c7e1a903431faba9ebef03061c0d` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:24.523487 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293640b-8cbe-4aff-b4c7-29f29a4b130a None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=41938583e61a45398e3e284c70204292, role_id=4803c7e1a903431faba9ebef03061c0d)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:24.525064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293640b-8cbe-4aff-b4c7-29f29a4b130a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:24.528001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee4fd1-ca81-4058-a0a4-7ab3b527cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:24.529028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4fd1-ca81-4058-a0a4-7ab3b527cc73 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:24.529554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4fd1-ca81-4058-a0a4-7ab3b527cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:24.530076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4fd1-ca81-4058-a0a4-7ab3b527cc73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:24.542779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee4fd1-ca81-4058-a0a4-7ab3b527cc73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:24.544633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee4fd1-ca81-4058-a0a4-7ab3b527cc73 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:24.554538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 309/611] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:46:24 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/41938583e61a45398e3e284c70204292/roles/4803c7e1a903431faba9ebef03061c0d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-edee4fd1-ca81-4058-a0a4-7ab3b527cc73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:24.564932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:24.565953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:24.566847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:24.566847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:24.566847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:24.566847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:24.569296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 303/612] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:24.575202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293640b-8cbe-4aff-b4c7-29f29a4b130a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:24.701998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293640b-8cbe-4aff-b4c7-29f29a4b130a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:24.744190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05149c-c011-4845-b90d-94a97cc25c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:24.745237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05149c-c011-4845-b90d-94a97cc25c34 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:24.745779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05149c-c011-4845-b90d-94a97cc25c34 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:24.746252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05149c-c011-4845-b90d-94a97cc25c34 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:24.747346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05149c-c011-4845-b90d-94a97cc25c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:24.747854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05149c-c011-4845-b90d-94a97cc25c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:24.749502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05149c-c011-4845-b90d-94a97cc25c34 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:24.763172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 310/613] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:24.770669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee4fd1-ca81-4058-a0a4-7ab3b527cc73 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:24.895678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee4fd1-ca81-4058-a0a4-7ab3b527cc73 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:24.929199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cc6de-aacb-4c78-a859-5a70f611f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:24.930364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cc6de-aacb-4c78-a859-5a70f611f390 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:24.931379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cc6de-aacb-4c78-a859-5a70f611f390 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:24.931857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cc6de-aacb-4c78-a859-5a70f611f390 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:24.940390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cc6de-aacb-4c78-a859-5a70f611f390 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:24.942148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cc6de-aacb-4c78-a859-5a70f611f390 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c89cc6de-aacb-4c78-a859-5a70f611f390 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:24.957005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:24.958022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:24.958955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:24.961600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 304/614] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:24.966853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05149c-c011-4845-b90d-94a97cc25c34 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:25.075814 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05149c-c011-4845-b90d-94a97cc25c34 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:25.110222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c424a4c-7817-49a4-8b96-0e0f0ddfb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:25.111238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c424a4c-7817-49a4-8b96-0e0f0ddfb20e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:25.111723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c424a4c-7817-49a4-8b96-0e0f0ddfb20e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:25.112219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c424a4c-7817-49a4-8b96-0e0f0ddfb20e None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:25.113252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c424a4c-7817-49a4-8b96-0e0f0ddfb20e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:25.113796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c424a4c-7817-49a4-8b96-0e0f0ddfb20e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:25.115434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c424a4c-7817-49a4-8b96-0e0f0ddfb20e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:25.140955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 311/615] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 12 18:46:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:25.146122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cc6de-aacb-4c78-a859-5a70f611f390 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:25.240565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ad2d-db56-48a8-9b42-5b1c2fd04d4f None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:25.241636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ad2d-db56-48a8-9b42-5b1c2fd04d4f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:25.242116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ad2d-db56-48a8-9b42-5b1c2fd04d4f None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:25.244527 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 312/616] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:25.249866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5894271-d38e-4ffd-8f62-713660be45f2 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:25.250396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5894271-d38e-4ffd-8f62-713660be45f2 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:25.250874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5894271-d38e-4ffd-8f62-713660be45f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:25.274514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d5894271-d38e-4ffd-8f62-713660be45f2 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:25.277358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d5894271-d38e-4ffd-8f62-713660be45f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:25.328914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cc6de-aacb-4c78-a859-5a70f611f390 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:25.389826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e6a50-2b06-4bce-abd2-ac75aad6c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:25.391177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e6a50-2b06-4bce-abd2-ac75aad6c01a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:25.391666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e6a50-2b06-4bce-abd2-ac75aad6c01a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:25.392398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e6a50-2b06-4bce-abd2-ac75aad6c01a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:25.406447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e6a50-2b06-4bce-abd2-ac75aad6c01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:25.409545 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e6a50-2b06-4bce-abd2-ac75aad6c01a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:25.421141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 313/617] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-3f9e6a50-2b06-4bce-abd2-ac75aad6c01a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:25.436516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:25.437430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:25.438344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:25.438344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:25.438344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:25.438344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:25.440580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 305/618] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:25.445762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5894271-d38e-4ffd-8f62-713660be45f2 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:25.459287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e6a50-2b06-4bce-abd2-ac75aad6c01a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:25.580270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5894271-d38e-4ffd-8f62-713660be45f2 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:25.626039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1baf39-3b5f-480b-ac61-522c489d450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:25.627086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1baf39-3b5f-480b-ac61-522c489d450b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:25.627379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1baf39-3b5f-480b-ac61-522c489d450b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:25.627823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1baf39-3b5f-480b-ac61-522c489d450b None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:25.629155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1baf39-3b5f-480b-ac61-522c489d450b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:25.629760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1baf39-3b5f-480b-ac61-522c489d450b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:25.631377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1baf39-3b5f-480b-ac61-522c489d450b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:25.656913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e6a50-2b06-4bce-abd2-ac75aad6c01a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:25.664878 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 314/619] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:25.670827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1baf39-3b5f-480b-ac61-522c489d450b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:25.692045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fdb1b-faa1-4024-9e11-8956edca1ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:25.693202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fdb1b-faa1-4024-9e11-8956edca1ab1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:25.693712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fdb1b-faa1-4024-9e11-8956edca1ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:25.694183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fdb1b-faa1-4024-9e11-8956edca1ab1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:25.705051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fdb1b-faa1-4024-9e11-8956edca1ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4d0fdb1b-faa1-4024-9e11-8956edca1ab1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:25.713642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:25.714555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:25.715394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:25.718038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 306/620] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:25.723676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fdb1b-faa1-4024-9e11-8956edca1ab1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:25.827709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fdb1b-faa1-4024-9e11-8956edca1ab1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:25.863228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd13113-7c86-4837-bb96-046fcaaea76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:25.864230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13113-7c86-4837-bb96-046fcaaea76e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:25.864712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13113-7c86-4837-bb96-046fcaaea76e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:25.865175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13113-7c86-4837-bb96-046fcaaea76e None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:25.866166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd13113-7c86-4837-bb96-046fcaaea76e None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:25.866669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd13113-7c86-4837-bb96-046fcaaea76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:25.868297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd13113-7c86-4837-bb96-046fcaaea76e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:25.876945 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 307/621] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:25.882489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd13113-7c86-4837-bb96-046fcaaea76e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:25.893216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1baf39-3b5f-480b-ac61-522c489d450b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:25.937743 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb523cd-86f2-40fa-a6a0-f4c37444f925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:25.938547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb523cd-86f2-40fa-a6a0-f4c37444f925 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:25.938832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb523cd-86f2-40fa-a6a0-f4c37444f925 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:25.939109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb523cd-86f2-40fa-a6a0-f4c37444f925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:25.954890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb523cd-86f2-40fa-a6a0-f4c37444f925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:25.956371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb523cd-86f2-40fa-a6a0-f4c37444f925 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-fbb523cd-86f2-40fa-a6a0-f4c37444f925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:25.978127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:25.979110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:25.980054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:25.980054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:25.980054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:25.980054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:25.980054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:25.980054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:25.980054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:25.980054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:25.985959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 315/622] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:25.991459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb523cd-86f2-40fa-a6a0-f4c37444f925 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:26.008284 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd13113-7c86-4837-bb96-046fcaaea76e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.057638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71295786-18c3-4503-a60b-6279ccf1b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:26.058794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71295786-18c3-4503-a60b-6279ccf1b275 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.059284 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71295786-18c3-4503-a60b-6279ccf1b275 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.059759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71295786-18c3-4503-a60b-6279ccf1b275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.070774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71295786-18c3-4503-a60b-6279ccf1b275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:26.073067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71295786-18c3-4503-a60b-6279ccf1b275 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-71295786-18c3-4503-a60b-6279ccf1b275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:26.091177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:26.092120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:26.093005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:26.093005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:26.093005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:26.093005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:26.093241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb523cd-86f2-40fa-a6a0-f4c37444f925 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.095351 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 308/623] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:26.100976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84dff-f355-4535-9ce4-7c62cd9b4b82 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.101577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84dff-f355-4535-9ce4-7c62cd9b4b82 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.102077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84dff-f355-4535-9ce4-7c62cd9b4b82 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.103899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 309/624] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:26.104847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c84dff-f355-4535-9ce4-7c62cd9b4b82 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:26.128963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ff5bc-e339-4bbd-b989-5559b89b300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:26.129666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ff5bc-e339-4bbd-b989-5559b89b300a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.129947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ff5bc-e339-4bbd-b989-5559b89b300a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.130221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ff5bc-e339-4bbd-b989-5559b89b300a None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.131007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ff5bc-e339-4bbd-b989-5559b89b300a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:26.131313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ff5bc-e339-4bbd-b989-5559b89b300a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:26.132731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ff5bc-e339-4bbd-b989-5559b89b300a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:26.145094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 316/625] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:26.151130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b778ea-a783-45dd-9e87-091553df302b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.151672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b778ea-a783-45dd-9e87-091553df302b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.152156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b778ea-a783-45dd-9e87-091553df302b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.181567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-74b778ea-a783-45dd-9e87-091553df302b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:26.181567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-74b778ea-a783-45dd-9e87-091553df302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:26.230939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c84dff-f355-4535-9ce4-7c62cd9b4b82 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.244883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 317/626] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:26.245667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b778ea-a783-45dd-9e87-091553df302b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:26.265680 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae17997-d7f6-4a0a-87b7-f8749a01e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:26.266346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae17997-d7f6-4a0a-87b7-f8749a01e3ee None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.266634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae17997-d7f6-4a0a-87b7-f8749a01e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.266895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae17997-d7f6-4a0a-87b7-f8749a01e3ee None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.267618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae17997-d7f6-4a0a-87b7-f8749a01e3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:26.267920 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae17997-d7f6-4a0a-87b7-f8749a01e3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:26.269283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae17997-d7f6-4a0a-87b7-f8749a01e3ee None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:26.281555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 310/627] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:26.284971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae17997-d7f6-4a0a-87b7-f8749a01e3ee None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:26.349081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b778ea-a783-45dd-9e87-091553df302b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.383353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412f29a-42ce-4527-94f0-4a0eb570d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:26.384770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412f29a-42ce-4527-94f0-4a0eb570d3e4 None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.385052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412f29a-42ce-4527-94f0-4a0eb570d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.385321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412f29a-42ce-4527-94f0-4a0eb570d3e4 None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/84eb7224717643288cc61f8e6f901543/roles/4803c7e1a903431faba9ebef03061c0d` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.389687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae17997-d7f6-4a0a-87b7-f8749a01e3ee None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.400192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412f29a-42ce-4527-94f0-4a0eb570d3e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=84eb7224717643288cc61f8e6f901543, role_id=4803c7e1a903431faba9ebef03061c0d)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:26.401693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412f29a-42ce-4527-94f0-4a0eb570d3e4 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:26.418446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 318/628] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:46:26 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/84eb7224717643288cc61f8e6f901543/roles/4803c7e1a903431faba9ebef03061c0d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:26.419428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412f29a-42ce-4527-94f0-4a0eb570d3e4 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:26.439417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdc1d8-620f-474b-8032-437e575b62f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:26.440247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdc1d8-620f-474b-8032-437e575b62f2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.440532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdc1d8-620f-474b-8032-437e575b62f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.440808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdc1d8-620f-474b-8032-437e575b62f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.470285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdc1d8-620f-474b-8032-437e575b62f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-6dcdc1d8-620f-474b-8032-437e575b62f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:26.478997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:26.481190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 311/629] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:26.483313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755113-39ab-435c-8924-6719ddd08055 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.485211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755113-39ab-435c-8924-6719ddd08055 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.485211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755113-39ab-435c-8924-6719ddd08055 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.485211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 312/630] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:26.489308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755113-39ab-435c-8924-6719ddd08055 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:26.547595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412f29a-42ce-4527-94f0-4a0eb570d3e4 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.600229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb1dc7-132c-4350-b80d-aac0d0608d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:26.601414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb1dc7-132c-4350-b80d-aac0d0608d7b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.601752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb1dc7-132c-4350-b80d-aac0d0608d7b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.602033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb1dc7-132c-4350-b80d-aac0d0608d7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.605329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755113-39ab-435c-8924-6719ddd08055 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.611867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb1dc7-132c-4350-b80d-aac0d0608d7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:26.613884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb1dc7-132c-4350-b80d-aac0d0608d7b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-c0cb1dc7-132c-4350-b80d-aac0d0608d7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:26.634503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:26.635875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:26.636871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 319/631] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 12 18:46:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:26.637507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4106-b68b-4e2c-a6a1-e0ca39b7411f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.637962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4106-b68b-4e2c-a6a1-e0ca39b7411f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.637962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4106-b68b-4e2c-a6a1-e0ca39b7411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.651580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b6bff-d43c-4353-8910-cd4ca14545df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:26.652260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b6bff-d43c-4353-8910-cd4ca14545df None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.653028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b6bff-d43c-4353-8910-cd4ca14545df None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.653319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b6bff-d43c-4353-8910-cd4ca14545df None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.654115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b6bff-d43c-4353-8910-cd4ca14545df None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:26.654427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b6bff-d43c-4353-8910-cd4ca14545df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:26.656621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b6bff-d43c-4353-8910-cd4ca14545df None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:26.661344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-de8b4106-b68b-4e2c-a6a1-e0ca39b7411f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:26.662572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-de8b4106-b68b-4e2c-a6a1-e0ca39b7411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:26.668460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 313/632] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:26.669225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b6bff-d43c-4353-8910-cd4ca14545df None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:26.746893 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 320/633] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:26.750502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4106-b68b-4e2c-a6a1-e0ca39b7411f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:26.789819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b6bff-d43c-4353-8910-cd4ca14545df None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.827220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072c6d-d9e5-424d-a413-11d255238501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:26.828653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072c6d-d9e5-424d-a413-11d255238501 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.829295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072c6d-d9e5-424d-a413-11d255238501 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.829856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072c6d-d9e5-424d-a413-11d255238501 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.831048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072c6d-d9e5-424d-a413-11d255238501 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:26.831842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072c6d-d9e5-424d-a413-11d255238501 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:26.833900 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072c6d-d9e5-424d-a413-11d255238501 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:26.854055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 314/634] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 12 18:46:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:26.855128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072c6d-d9e5-424d-a413-11d255238501 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:26.883703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4106-b68b-4e2c-a6a1-e0ca39b7411f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.930314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ba387-da60-4170-afa1-4dd26c62401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:26.931982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ba387-da60-4170-afa1-4dd26c62401d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:26.932334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ba387-da60-4170-afa1-4dd26c62401d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:26.933447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ba387-da60-4170-afa1-4dd26c62401d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:26.945981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ba387-da60-4170-afa1-4dd26c62401d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:26.948604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ba387-da60-4170-afa1-4dd26c62401d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:26.963152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072c6d-d9e5-424d-a413-11d255238501 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-835ba387-da60-4170-afa1-4dd26c62401d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:26.970385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:26.971301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:26.972201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:26.972201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:26.972201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:26.972201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:26.976651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 321/635] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:26.977575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ba387-da60-4170-afa1-4dd26c62401d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.004979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e9409-30d0-4b00-908c-5cc0e6023a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.006375 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e9409-30d0-4b00-908c-5cc0e6023a46 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.006899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e9409-30d0-4b00-908c-5cc0e6023a46 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.007380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e9409-30d0-4b00-908c-5cc0e6023a46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.019535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e9409-30d0-4b00-908c-5cc0e6023a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d34e9409-30d0-4b00-908c-5cc0e6023a46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:27.030973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:27.031979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:27.032824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:27.035708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 315/636] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:27.036837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e9409-30d0-4b00-908c-5cc0e6023a46 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.104950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ba387-da60-4170-afa1-4dd26c62401d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.144607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e9409-30d0-4b00-908c-5cc0e6023a46 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.149776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fed0b0-c7f1-4cb0-8c64-0cd8d327ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.150430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed0b0-c7f1-4cb0-8c64-0cd8d327ff0e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.150714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed0b0-c7f1-4cb0-8c64-0cd8d327ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.150990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed0b0-c7f1-4cb0-8c64-0cd8d327ff0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.184461 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf8cd3-f28a-4db7-abc0-95899e62a6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.185218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf8cd3-f28a-4db7-abc0-95899e62a6e3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.185509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf8cd3-f28a-4db7-abc0-95899e62a6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.185814 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf8cd3-f28a-4db7-abc0-95899e62a6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.186951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf8cd3-f28a-4db7-abc0-95899e62a6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:27.187268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf8cd3-f28a-4db7-abc0-95899e62a6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:27.188909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf8cd3-f28a-4db7-abc0-95899e62a6e3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:27.206428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 316/637] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:27.207610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf8cd3-f28a-4db7-abc0-95899e62a6e3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.232746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed0b0-c7f1-4cb0-8c64-0cd8d327ff0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:27.234692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed0b0-c7f1-4cb0-8c64-0cd8d327ff0e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:27.323551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf8cd3-f28a-4db7-abc0-95899e62a6e3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.332717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 322/638] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:27.333578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fed0b0-c7f1-4cb0-8c64-0cd8d327ff0e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.359778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ba969-fc44-4548-95b9-f9e28a2a052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.360444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ba969-fc44-4548-95b9-f9e28a2a052f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.360731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ba969-fc44-4548-95b9-f9e28a2a052f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.361008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ba969-fc44-4548-95b9-f9e28a2a052f None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.361792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ba969-fc44-4548-95b9-f9e28a2a052f None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:27.362097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ba969-fc44-4548-95b9-f9e28a2a052f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:27.363455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ba969-fc44-4548-95b9-f9e28a2a052f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:27.371985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 317/639] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:27.377386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0732e-d7d2-4a4d-9edd-1aa0301d863d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.377705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0732e-d7d2-4a4d-9edd-1aa0301d863d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.377984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0732e-d7d2-4a4d-9edd-1aa0301d863d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.379228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 318/640] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:27.379911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0732e-d7d2-4a4d-9edd-1aa0301d863d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.443766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fed0b0-c7f1-4cb0-8c64-0cd8d327ff0e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.475176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341385-1bd6-4dce-8ae3-72bffd3cf71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.475969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341385-1bd6-4dce-8ae3-72bffd3cf71f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.476253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341385-1bd6-4dce-8ae3-72bffd3cf71f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.476528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341385-1bd6-4dce-8ae3-72bffd3cf71f None admin] PATH_INFO: `/v3/users/glance` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.477338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0732e-d7d2-4a4d-9edd-1aa0301d863d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.483974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25341385-1bd6-4dce-8ae3-72bffd3cf71f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:27.485406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25341385-1bd6-4dce-8ae3-72bffd3cf71f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-25341385-1bd6-4dce-8ae3-72bffd3cf71f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:27.500185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:27.501298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 18:46:27.502504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:27.507368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 323/641] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:27.507368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341385-1bd6-4dce-8ae3-72bffd3cf71f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.515723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebd02d-edc9-4bb8-9018-5e498b498da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.516516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebd02d-edc9-4bb8-9018-5e498b498da8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.516799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebd02d-edc9-4bb8-9018-5e498b498da8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.517076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebd02d-edc9-4bb8-9018-5e498b498da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.526937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebd02d-edc9-4bb8-9018-5e498b498da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:27.528406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebd02d-edc9-4bb8-9018-5e498b498da8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c3ebd02d-edc9-4bb8-9018-5e498b498da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:27.545611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:27.546881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:27.547810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:27.547810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:27.547810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:27.547810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:27.547810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 319/642] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:27.548516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf689-203d-45da-a704-b261c19e7cf3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.548516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf689-203d-45da-a704-b261c19e7cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.548787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf689-203d-45da-a704-b261c19e7cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.567622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d6ddf689-203d-45da-a704-b261c19e7cf3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:27.568787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d6ddf689-203d-45da-a704-b261c19e7cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:27.609857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341385-1bd6-4dce-8ae3-72bffd3cf71f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.639908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 320/643] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:27.639908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddf689-203d-45da-a704-b261c19e7cf3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.660213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63b200-4488-4c7e-837c-36bf8ec95a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.661040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63b200-4488-4c7e-837c-36bf8ec95a5a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.661324 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63b200-4488-4c7e-837c-36bf8ec95a5a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.661637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63b200-4488-4c7e-837c-36bf8ec95a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.673761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63b200-4488-4c7e-837c-36bf8ec95a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:27.675212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63b200-4488-4c7e-837c-36bf8ec95a5a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-5b63b200-4488-4c7e-837c-36bf8ec95a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:27.693271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:27.694282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:27.695264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:27.695264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:27.695264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:27.695264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:27.695264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 324/644] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:27.695264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63b200-4488-4c7e-837c-36bf8ec95a5a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.750011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddf689-203d-45da-a704-b261c19e7cf3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.784379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59a95-4afa-48af-ad54-a5df235c5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.785048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59a95-4afa-48af-ad54-a5df235c5041 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.785467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59a95-4afa-48af-ad54-a5df235c5041 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.786050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59a95-4afa-48af-ad54-a5df235c5041 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.787058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d59a95-4afa-48af-ad54-a5df235c5041 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:27.787366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d59a95-4afa-48af-ad54-a5df235c5041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:27.788795 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d59a95-4afa-48af-ad54-a5df235c5041 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:27.793425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63b200-4488-4c7e-837c-36bf8ec95a5a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.806224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 321/645] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:27.807072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59a95-4afa-48af-ad54-a5df235c5041 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.837724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0a812-7747-4bf6-a41f-3519bc5c3f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.838648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0a812-7747-4bf6-a41f-3519bc5c3f46 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.839088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0a812-7747-4bf6-a41f-3519bc5c3f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.839524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0a812-7747-4bf6-a41f-3519bc5c3f46 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.840248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0a812-7747-4bf6-a41f-3519bc5c3f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:27.840560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0a812-7747-4bf6-a41f-3519bc5c3f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:27.841976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0a812-7747-4bf6-a41f-3519bc5c3f46 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:27.855503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 325/646] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:27.856135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0a812-7747-4bf6-a41f-3519bc5c3f46 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.908087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59a95-4afa-48af-ad54-a5df235c5041 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.946343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9003d0-0a66-4f69-8312-0232d17ad5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.947068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9003d0-0a66-4f69-8312-0232d17ad5c3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.947350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9003d0-0a66-4f69-8312-0232d17ad5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.947690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9003d0-0a66-4f69-8312-0232d17ad5c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.954968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0a812-7747-4bf6-a41f-3519bc5c3f46 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:27.957660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9003d0-0a66-4f69-8312-0232d17ad5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-2c9003d0-0a66-4f69-8312-0232d17ad5c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:27.965924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:27.966878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 322/647] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:27.968316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9003d0-0a66-4f69-8312-0232d17ad5c3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:27.989300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579bd2d-a61a-4bc9-a699-7e32502b3a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:27.989995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579bd2d-a61a-4bc9-a699-7e32502b3a4c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:27.990294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579bd2d-a61a-4bc9-a699-7e32502b3a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:27.990561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579bd2d-a61a-4bc9-a699-7e32502b3a4c None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:27.991271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579bd2d-a61a-4bc9-a699-7e32502b3a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:27.991580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579bd2d-a61a-4bc9-a699-7e32502b3a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:27.992964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579bd2d-a61a-4bc9-a699-7e32502b3a4c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.009597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 326/648] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:28.009597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579bd2d-a61a-4bc9-a699-7e32502b3a4c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.073312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9003d0-0a66-4f69-8312-0232d17ad5c3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.102330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579bd2d-a61a-4bc9-a699-7e32502b3a4c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.105402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72e5f-ca9c-4d3b-8c33-22851391b1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.106066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72e5f-ca9c-4d3b-8c33-22851391b1ad None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.106348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72e5f-ca9c-4d3b-8c33-22851391b1ad None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.106617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72e5f-ca9c-4d3b-8c33-22851391b1ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.136071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cabfc-fdc6-4289-b775-d2e44d965450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.136862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cabfc-fdc6-4289-b775-d2e44d965450 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.137148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cabfc-fdc6-4289-b775-d2e44d965450 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.137423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cabfc-fdc6-4289-b775-d2e44d965450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.144204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cabfc-fdc6-4289-b775-d2e44d965450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.145689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cabfc-fdc6-4289-b775-d2e44d965450 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-a13cabfc-fdc6-4289-b775-d2e44d965450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:28.160000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:28.160915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:28.161896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:28.161896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:28.161896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:28.161896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:28.161896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:28.161896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:28.161896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:28.161896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:28.161896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 327/649] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:28.162394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cabfc-fdc6-4289-b775-d2e44d965450 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.183244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a72e5f-ca9c-4d3b-8c33-22851391b1ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.184684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a72e5f-ca9c-4d3b-8c33-22851391b1ad None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.265601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cabfc-fdc6-4289-b775-d2e44d965450 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.285565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 323/650] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:28.286426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72e5f-ca9c-4d3b-8c33-22851391b1ad None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.300779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c16df-d7fe-470e-bde0-08ac44950601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.301445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c16df-d7fe-470e-bde0-08ac44950601 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.301757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c16df-d7fe-470e-bde0-08ac44950601 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.302035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c16df-d7fe-470e-bde0-08ac44950601 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.302811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c16df-d7fe-470e-bde0-08ac44950601 None admin] RBAC: Adding query filter params (name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:28.303116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c16df-d7fe-470e-bde0-08ac44950601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.304496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c16df-d7fe-470e-bde0-08ac44950601 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.312480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 328/651] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:28.313264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c16df-d7fe-470e-bde0-08ac44950601 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.392558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72e5f-ca9c-4d3b-8c33-22851391b1ad None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.412907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c16df-d7fe-470e-bde0-08ac44950601 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.426520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd2868-4ec9-4e6a-810a-2a8964976aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.427505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd2868-4ec9-4e6a-810a-2a8964976aed None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.427780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd2868-4ec9-4e6a-810a-2a8964976aed None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.428052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd2868-4ec9-4e6a-810a-2a8964976aed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.436154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd2868-4ec9-4e6a-810a-2a8964976aed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.437625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd2868-4ec9-4e6a-810a-2a8964976aed None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.446956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430e3cb-00dd-4bb0-8848-b802baa3b214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.447601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430e3cb-00dd-4bb0-8848-b802baa3b214 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.447879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430e3cb-00dd-4bb0-8848-b802baa3b214 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.448151 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430e3cb-00dd-4bb0-8848-b802baa3b214 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.448925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430e3cb-00dd-4bb0-8848-b802baa3b214 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:28.449229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430e3cb-00dd-4bb0-8848-b802baa3b214 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.450673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430e3cb-00dd-4bb0-8848-b802baa3b214 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-15fd2868-4ec9-4e6a-810a-2a8964976aed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:28.453056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:28.454240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 324/652] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:28.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd2868-4ec9-4e6a-810a-2a8964976aed None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.472742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 329/653] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:28.472742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430e3cb-00dd-4bb0-8848-b802baa3b214 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.566556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430e3cb-00dd-4bb0-8848-b802baa3b214 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.567812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd2868-4ec9-4e6a-810a-2a8964976aed None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.602143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4643a6-7248-4c1a-a20e-2509e6429b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.602963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4643a6-7248-4c1a-a20e-2509e6429b52 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.603247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4643a6-7248-4c1a-a20e-2509e6429b52 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.603524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4643a6-7248-4c1a-a20e-2509e6429b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.604550 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32313dc9-59b0-4e07-8144-2bc9410c630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.605495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32313dc9-59b0-4e07-8144-2bc9410c630c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.605953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32313dc9-59b0-4e07-8144-2bc9410c630c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.606372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32313dc9-59b0-4e07-8144-2bc9410c630c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.613575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4643a6-7248-4c1a-a20e-2509e6429b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.614999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4643a6-7248-4c1a-a20e-2509e6429b52 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.616622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32313dc9-59b0-4e07-8144-2bc9410c630c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.618590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32313dc9-59b0-4e07-8144-2bc9410c630c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-bc4643a6-7248-4c1a-a20e-2509e6429b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:28.633323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:28.634826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:28.635711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:28.635711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:28.635711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:28.635711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-32313dc9-59b0-4e07-8144-2bc9410c630c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:28.636327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:28.637133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:28.642684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:28.642684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:28.642684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:28.642684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:28.642684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 325/654] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:28.642684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32313dc9-59b0-4e07-8144-2bc9410c630c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.643022 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 330/655] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:28.643022 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4643a6-7248-4c1a-a20e-2509e6429b52 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.735980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4643a6-7248-4c1a-a20e-2509e6429b52 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.738165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32313dc9-59b0-4e07-8144-2bc9410c630c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.768949 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318d6c-b39b-457a-b93c-34912132f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.769617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318d6c-b39b-457a-b93c-34912132f125 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.769904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318d6c-b39b-457a-b93c-34912132f125 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.770178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318d6c-b39b-457a-b93c-34912132f125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.770417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca756bc-2fb8-4eb4-9594-ac02a8581e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.771001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa318d6c-b39b-457a-b93c-34912132f125 None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=e2e41b41f355446c8462fafcd91c183f) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:28.771094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca756bc-2fb8-4eb4-9594-ac02a8581e76 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.771311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa318d6c-b39b-457a-b93c-34912132f125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.771399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca756bc-2fb8-4eb4-9594-ac02a8581e76 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.771611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca756bc-2fb8-4eb4-9594-ac02a8581e76 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.772439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca756bc-2fb8-4eb4-9594-ac02a8581e76 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:28.772732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa318d6c-b39b-457a-b93c-34912132f125 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.772836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca756bc-2fb8-4eb4-9594-ac02a8581e76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.774181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca756bc-2fb8-4eb4-9594-ac02a8581e76 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.778338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 331/656] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/role_assignments?user.id=e2e41b41f355446c8462fafcd91c183f&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:28.779106 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318d6c-b39b-457a-b93c-34912132f125 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.796733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 326/657] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:28.796733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca756bc-2fb8-4eb4-9594-ac02a8581e76 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.882399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318d6c-b39b-457a-b93c-34912132f125 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.898867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca756bc-2fb8-4eb4-9594-ac02a8581e76 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:28.917280 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158e441-8e29-4286-bfbd-2e640a5c8266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.918131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158e441-8e29-4286-bfbd-2e640a5c8266 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.918509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158e441-8e29-4286-bfbd-2e640a5c8266 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.918880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158e441-8e29-4286-bfbd-2e640a5c8266 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.919717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158e441-8e29-4286-bfbd-2e640a5c8266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:28.920135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158e441-8e29-4286-bfbd-2e640a5c8266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.921923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158e441-8e29-4286-bfbd-2e640a5c8266 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.938923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 332/658] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:28.939144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8a527-afca-4c9b-a93a-3b606daba522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:28.939144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8a527-afca-4c9b-a93a-3b606daba522 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.939329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8334489-fb7c-44e3-be47-b81adbade952 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:28.939407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8a527-afca-4c9b-a93a-3b606daba522 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.939484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8334489-fb7c-44e3-be47-b81adbade952 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:28.939555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8a527-afca-4c9b-a93a-3b606daba522 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.939632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8334489-fb7c-44e3-be47-b81adbade952 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:28.939710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8a527-afca-4c9b-a93a-3b606daba522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:28.939710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8a527-afca-4c9b-a93a-3b606daba522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:28.939710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8a527-afca-4c9b-a93a-3b606daba522 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:28.941698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 333/659] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:28.942587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8334489-fb7c-44e3-be47-b81adbade952 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:28.955858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 327/660] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:28.955858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8a527-afca-4c9b-a93a-3b606daba522 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:29.055168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8334489-fb7c-44e3-be47-b81adbade952 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:29.058616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8a527-afca-4c9b-a93a-3b606daba522 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:29.087709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277153b-2962-4161-9d4e-35f37109f26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:29.088550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277153b-2962-4161-9d4e-35f37109f26e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.088930 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277153b-2962-4161-9d4e-35f37109f26e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.089361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277153b-2962-4161-9d4e-35f37109f26e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.090810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa834f71-5c9b-427f-9217-0f6c1b7331ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:29.091604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa834f71-5c9b-427f-9217-0f6c1b7331ed None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.091883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa834f71-5c9b-427f-9217-0f6c1b7331ed None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.092244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa834f71-5c9b-427f-9217-0f6c1b7331ed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.099542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa834f71-5c9b-427f-9217-0f6c1b7331ed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:29.100980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa834f71-5c9b-427f-9217-0f6c1b7331ed None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-fa834f71-5c9b-427f-9217-0f6c1b7331ed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:29.115993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:29.117151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:29.118716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 328/661] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:29.119338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b84ad-e4d1-452c-9196-ed89656d01ff None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.119338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b84ad-e4d1-452c-9196-ed89656d01ff None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.119475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b84ad-e4d1-452c-9196-ed89656d01ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.136548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a20b84ad-e4d1-452c-9196-ed89656d01ff None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:29.137703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a20b84ad-e4d1-452c-9196-ed89656d01ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:29.159855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277153b-2962-4161-9d4e-35f37109f26e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:29.161294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277153b-2962-4161-9d4e-35f37109f26e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:29.267754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 334/662] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:29.267754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277153b-2962-4161-9d4e-35f37109f26e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:29.324396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 329/663] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:29.325471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b84ad-e4d1-452c-9196-ed89656d01ff None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:29.363778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277153b-2962-4161-9d4e-35f37109f26e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:29.396633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659cc28-80dc-4e30-b9d4-25b3b78fde13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:29.397344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659cc28-80dc-4e30-b9d4-25b3b78fde13 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.397651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659cc28-80dc-4e30-b9d4-25b3b78fde13 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.397929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659cc28-80dc-4e30-b9d4-25b3b78fde13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.405013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659cc28-80dc-4e30-b9d4-25b3b78fde13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:29.407410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659cc28-80dc-4e30-b9d4-25b3b78fde13 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-9659cc28-80dc-4e30-b9d4-25b3b78fde13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:29.422853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:29.424339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:29.425406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:29.425406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:29.425406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:29.425406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:29.425406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:29.425406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:29.425406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:29.425406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:29.426451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 335/664] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:29.427637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659cc28-80dc-4e30-b9d4-25b3b78fde13 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:29.437941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b84ad-e4d1-452c-9196-ed89656d01ff None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:29.474408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93f1c8-88a9-4f96-9875-6d4ddc4d7adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:29.475210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f1c8-88a9-4f96-9875-6d4ddc4d7adc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.475566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f1c8-88a9-4f96-9875-6d4ddc4d7adc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.475838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f1c8-88a9-4f96-9875-6d4ddc4d7adc None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.476669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93f1c8-88a9-4f96-9875-6d4ddc4d7adc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:29.476972 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93f1c8-88a9-4f96-9875-6d4ddc4d7adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:29.479103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93f1c8-88a9-4f96-9875-6d4ddc4d7adc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:29.495287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 330/665] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 12 18:46:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:29.496062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93f1c8-88a9-4f96-9875-6d4ddc4d7adc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:29.536556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659cc28-80dc-4e30-b9d4-25b3b78fde13 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:29.569546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc8833-5af0-4043-a4f8-c238bdebaa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:29.570418 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8833-5af0-4043-a4f8-c238bdebaa5b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.570765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8833-5af0-4043-a4f8-c238bdebaa5b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.571145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8833-5af0-4043-a4f8-c238bdebaa5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.582205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8833-5af0-4043-a4f8-c238bdebaa5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:29.583743 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8833-5af0-4043-a4f8-c238bdebaa5b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:29.595056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93f1c8-88a9-4f96-9875-6d4ddc4d7adc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-51fc8833-5af0-4043-a4f8-c238bdebaa5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:29.601567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:29.602651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:29.603747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:29.603747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:29.603747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:29.603747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:29.604352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 336/666] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:29.605620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc8833-5af0-4043-a4f8-c238bdebaa5b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:29.630121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da69a4-5ab1-43a7-926e-d4fd564affab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:29.631047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da69a4-5ab1-43a7-926e-d4fd564affab None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.631425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da69a4-5ab1-43a7-926e-d4fd564affab None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.631759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da69a4-5ab1-43a7-926e-d4fd564affab None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.642230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da69a4-5ab1-43a7-926e-d4fd564affab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c2da69a4-5ab1-43a7-926e-d4fd564affab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:29.650510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:29.651621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:29.652660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:29.657806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 331/667] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:29.658644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da69a4-5ab1-43a7-926e-d4fd564affab None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:29.713516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc8833-5af0-4043-a4f8-c238bdebaa5b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:29.745766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd89b22-1fa7-45a0-ae3e-cbd661027634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:29.746421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd89b22-1fa7-45a0-ae3e-cbd661027634 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.746703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd89b22-1fa7-45a0-ae3e-cbd661027634 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.746981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd89b22-1fa7-45a0-ae3e-cbd661027634 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.747761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd89b22-1fa7-45a0-ae3e-cbd661027634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:29.748074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd89b22-1fa7-45a0-ae3e-cbd661027634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:29.749492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd89b22-1fa7-45a0-ae3e-cbd661027634 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:29.760867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da69a4-5ab1-43a7-926e-d4fd564affab None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:29.761751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 337/668] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:29.762357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd89b22-1fa7-45a0-ae3e-cbd661027634 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:29.797951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a4c28-7816-4f1f-8127-f5e4c2ab7d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:29.798686 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a4c28-7816-4f1f-8127-f5e4c2ab7d6c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.798969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a4c28-7816-4f1f-8127-f5e4c2ab7d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.799236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a4c28-7816-4f1f-8127-f5e4c2ab7d6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.856053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd89b22-1fa7-45a0-ae3e-cbd661027634 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:29.863008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a4c28-7816-4f1f-8127-f5e4c2ab7d6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:29.864433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a4c28-7816-4f1f-8127-f5e4c2ab7d6c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:29.888550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f03ec-7854-4953-b18d-56cafbc4ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:29.889287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f03ec-7854-4953-b18d-56cafbc4ffbf None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:29.889601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f03ec-7854-4953-b18d-56cafbc4ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:29.889880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f03ec-7854-4953-b18d-56cafbc4ffbf None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:29.890595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f03ec-7854-4953-b18d-56cafbc4ffbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:29.890902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f03ec-7854-4953-b18d-56cafbc4ffbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:29.892253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f03ec-7854-4953-b18d-56cafbc4ffbf None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:29.908011 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 338/669] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:29.908011 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f03ec-7854-4953-b18d-56cafbc4ffbf None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:29.968195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 332/670] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:29.968195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a4c28-7816-4f1f-8127-f5e4c2ab7d6c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.001358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f03ec-7854-4953-b18d-56cafbc4ffbf None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.036896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9bea6-ee54-45e1-a608-e3211eda53bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.037593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9bea6-ee54-45e1-a608-e3211eda53bc None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.037883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9bea6-ee54-45e1-a608-e3211eda53bc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.038161 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9bea6-ee54-45e1-a608-e3211eda53bc None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.038935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9bea6-ee54-45e1-a608-e3211eda53bc None admin] RBAC: Adding query filter params (name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:30.039244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9bea6-ee54-45e1-a608-e3211eda53bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.040649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9bea6-ee54-45e1-a608-e3211eda53bc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.048969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 339/671] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:30.049903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9bea6-ee54-45e1-a608-e3211eda53bc None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.067968 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a4c28-7816-4f1f-8127-f5e4c2ab7d6c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.100831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577b953-5c79-4d5a-ad96-1c39692925f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.101614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577b953-5c79-4d5a-ad96-1c39692925f4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.101899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577b953-5c79-4d5a-ad96-1c39692925f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.102168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577b953-5c79-4d5a-ad96-1c39692925f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.103061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577b953-5c79-4d5a-ad96-1c39692925f4 None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=066d62c015e9483e87e4bd64ce8c4df7) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:30.103373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577b953-5c79-4d5a-ad96-1c39692925f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.104789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577b953-5c79-4d5a-ad96-1c39692925f4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.121953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 333/672] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:29 2022] GET /identity/v3/role_assignments?user.id=066d62c015e9483e87e4bd64ce8c4df7&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:30.121953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577b953-5c79-4d5a-ad96-1c39692925f4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.151553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9bea6-ee54-45e1-a608-e3211eda53bc None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.187791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6536-e478-4570-9067-f3d4a4864281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.188599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6536-e478-4570-9067-f3d4a4864281 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.188922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6536-e478-4570-9067-f3d4a4864281 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.189204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6536-e478-4570-9067-f3d4a4864281 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.197610 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f6536-e478-4570-9067-f3d4a4864281 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.199099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f6536-e478-4570-9067-f3d4a4864281 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-af1f6536-e478-4570-9067-f3d4a4864281 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:30.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:30.216366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 340/673] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:30.217898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6536-e478-4570-9067-f3d4a4864281 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.229135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577b953-5c79-4d5a-ad96-1c39692925f4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.265449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92264351-a0ed-4b58-9dd5-21375d812d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.266307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264351-a0ed-4b58-9dd5-21375d812d30 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.266584 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264351-a0ed-4b58-9dd5-21375d812d30 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.266851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264351-a0ed-4b58-9dd5-21375d812d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.278843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92264351-a0ed-4b58-9dd5-21375d812d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.280455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92264351-a0ed-4b58-9dd5-21375d812d30 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-92264351-a0ed-4b58-9dd5-21375d812d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:30.299650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:30.301923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:30.304150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:30.304150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:30.304150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:30.304150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:30.304150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 334/674] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:30.304150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92264351-a0ed-4b58-9dd5-21375d812d30 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.323472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6536-e478-4570-9067-f3d4a4864281 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.358721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58ecee-312e-4aa8-8dcd-1c8b8e39ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.359516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58ecee-312e-4aa8-8dcd-1c8b8e39ee0b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.359797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58ecee-312e-4aa8-8dcd-1c8b8e39ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.360075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58ecee-312e-4aa8-8dcd-1c8b8e39ee0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.371503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58ecee-312e-4aa8-8dcd-1c8b8e39ee0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.373200 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58ecee-312e-4aa8-8dcd-1c8b8e39ee0b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-da58ecee-312e-4aa8-8dcd-1c8b8e39ee0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:30.391087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:30.392241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:30.393347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:30.393347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:30.393347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:30.393347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:30.395326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 341/675] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:30.396266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58ecee-312e-4aa8-8dcd-1c8b8e39ee0b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.406317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92264351-a0ed-4b58-9dd5-21375d812d30 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.443314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a3c34-4f46-4476-a940-fd25c8d0d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.443903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a3c34-4f46-4476-a940-fd25c8d0d23f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.444174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a3c34-4f46-4476-a940-fd25c8d0d23f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.444450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a3c34-4f46-4476-a940-fd25c8d0d23f None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.445805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a3c34-4f46-4476-a940-fd25c8d0d23f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:30.446401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a3c34-4f46-4476-a940-fd25c8d0d23f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.448643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a3c34-4f46-4476-a940-fd25c8d0d23f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.466878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 335/676] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:30.468204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a3c34-4f46-4476-a940-fd25c8d0d23f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.509084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58ecee-312e-4aa8-8dcd-1c8b8e39ee0b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.543591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a33c4-99e5-4799-aa01-cff2b6811344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.544260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a33c4-99e5-4799-aa01-cff2b6811344 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.544537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a33c4-99e5-4799-aa01-cff2b6811344 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.544806 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a33c4-99e5-4799-aa01-cff2b6811344 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.545543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a33c4-99e5-4799-aa01-cff2b6811344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:30.545844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a33c4-99e5-4799-aa01-cff2b6811344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.547515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a33c4-99e5-4799-aa01-cff2b6811344 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.559891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 342/677] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:30.560848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a33c4-99e5-4799-aa01-cff2b6811344 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.596095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a3c34-4f46-4476-a940-fd25c8d0d23f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.638828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdca4d-547a-42cf-bb61-18c80e1e20c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.639506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdca4d-547a-42cf-bb61-18c80e1e20c1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.639792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdca4d-547a-42cf-bb61-18c80e1e20c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.640070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdca4d-547a-42cf-bb61-18c80e1e20c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.640797 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdca4d-547a-42cf-bb61-18c80e1e20c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:30.641104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdca4d-547a-42cf-bb61-18c80e1e20c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.642498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdca4d-547a-42cf-bb61-18c80e1e20c1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.659278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 336/678] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:30.660220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdca4d-547a-42cf-bb61-18c80e1e20c1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.674924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a33c4-99e5-4799-aa01-cff2b6811344 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.723187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7f861-316d-4f5d-9883-7f7f895abb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.723926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7f861-316d-4f5d-9883-7f7f895abb83 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.724506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7f861-316d-4f5d-9883-7f7f895abb83 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.724796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7f861-316d-4f5d-9883-7f7f895abb83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.726013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7f861-316d-4f5d-9883-7f7f895abb83 None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=c25d2d15ebf644b889ab453d1b7ed277) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:30.726327 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7f861-316d-4f5d-9883-7f7f895abb83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.727969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7f861-316d-4f5d-9883-7f7f895abb83 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.735943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 343/679] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/role_assignments?user.id=c25d2d15ebf644b889ab453d1b7ed277&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:30.737183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7f861-316d-4f5d-9883-7f7f895abb83 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.789698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdca4d-547a-42cf-bb61-18c80e1e20c1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.890063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee08d83-39b7-4176-bc17-dbab8882fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.890959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee08d83-39b7-4176-bc17-dbab8882fb1a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.891243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee08d83-39b7-4176-bc17-dbab8882fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.891518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee08d83-39b7-4176-bc17-dbab8882fb1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.903229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee08d83-39b7-4176-bc17-dbab8882fb1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.904774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee08d83-39b7-4176-bc17-dbab8882fb1a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:30.922164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7f861-316d-4f5d-9883-7f7f895abb83 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-eee08d83-39b7-4176-bc17-dbab8882fb1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:30.931846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:30.932820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:30.933768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:30.933768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:30.933768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:30.933768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:30.933768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:30.933768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:30.933768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:30.933768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:30.933768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 337/680] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:30.943697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee08d83-39b7-4176-bc17-dbab8882fb1a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:30.978791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249dea9-2494-494a-aa8f-25b84763cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:30.979909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249dea9-2494-494a-aa8f-25b84763cc3d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:30.980415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249dea9-2494-494a-aa8f-25b84763cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:30.982857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249dea9-2494-494a-aa8f-25b84763cc3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:30.991273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249dea9-2494-494a-aa8f-25b84763cc3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:30.993623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249dea9-2494-494a-aa8f-25b84763cc3d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-c249dea9-2494-494a-aa8f-25b84763cc3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:31.010037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:31.011041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:31.011984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:31.014728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 344/681] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:31.021902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249dea9-2494-494a-aa8f-25b84763cc3d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:31.064633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee08d83-39b7-4176-bc17-dbab8882fb1a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:31.102995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dac6f-2b41-4727-bfcf-9da252b708bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:31.103933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dac6f-2b41-4727-bfcf-9da252b708bb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.104395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dac6f-2b41-4727-bfcf-9da252b708bb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.104831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dac6f-2b41-4727-bfcf-9da252b708bb None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.105825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dac6f-2b41-4727-bfcf-9da252b708bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:31.106284 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dac6f-2b41-4727-bfcf-9da252b708bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:31.107868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dac6f-2b41-4727-bfcf-9da252b708bb None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:31.121352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 338/682] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:31.129581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dac6f-2b41-4727-bfcf-9da252b708bb None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:31.132047 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249dea9-2494-494a-aa8f-25b84763cc3d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:31.171675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2c293-59e5-4871-af55-e6c3d9fbda3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:31.172355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c293-59e5-4871-af55-e6c3d9fbda3d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.172632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c293-59e5-4871-af55-e6c3d9fbda3d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.172900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c293-59e5-4871-af55-e6c3d9fbda3d None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.174377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2c293-59e5-4871-af55-e6c3d9fbda3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:31.174377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2c293-59e5-4871-af55-e6c3d9fbda3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:31.175486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2c293-59e5-4871-af55-e6c3d9fbda3d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:31.194155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 345/683] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 12 18:46:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:31.199203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529ee14-8194-45e3-b3d7-d9097ffdc1b0 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.199203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529ee14-8194-45e3-b3d7-d9097ffdc1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.199203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529ee14-8194-45e3-b3d7-d9097ffdc1b0 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.199203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 346/684] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:31.200051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529ee14-8194-45e3-b3d7-d9097ffdc1b0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:31.261692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dac6f-2b41-4727-bfcf-9da252b708bb None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:31.303976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529ee14-8194-45e3-b3d7-d9097ffdc1b0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:31.306695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504d54b-87c8-4d83-a9c5-37e17dc97cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:31.308373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504d54b-87c8-4d83-a9c5-37e17dc97cb6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.308810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504d54b-87c8-4d83-a9c5-37e17dc97cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.309232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504d54b-87c8-4d83-a9c5-37e17dc97cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.310292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504d54b-87c8-4d83-a9c5-37e17dc97cb6 None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=41938583e61a45398e3e284c70204292) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:31.310755 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504d54b-87c8-4d83-a9c5-37e17dc97cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:31.312842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504d54b-87c8-4d83-a9c5-37e17dc97cb6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:31.321366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 339/685] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:31 2022] GET /identity/v3/role_assignments?user.id=41938583e61a45398e3e284c70204292&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:31.323296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445977b8-9ed2-4ded-89b3-e423f1a0f5d9 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.323739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445977b8-9ed2-4ded-89b3-e423f1a0f5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.324215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445977b8-9ed2-4ded-89b3-e423f1a0f5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.340425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a11dfe-9635-41a2-a7e4-c140b1060b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:31.341275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a11dfe-9635-41a2-a7e4-c140b1060b7b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.341572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a11dfe-9635-41a2-a7e4-c140b1060b7b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.341906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a11dfe-9635-41a2-a7e4-c140b1060b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.347118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-445977b8-9ed2-4ded-89b3-e423f1a0f5d9 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:31.348691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-445977b8-9ed2-4ded-89b3-e423f1a0f5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:31.414840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a11dfe-9635-41a2-a7e4-c140b1060b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:31.416395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a11dfe-9635-41a2-a7e4-c140b1060b7b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:31.441973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 340/686] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:31.488553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445977b8-9ed2-4ded-89b3-e423f1a0f5d9 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:31.560594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 347/687] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 18:46:31.571238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a11dfe-9635-41a2-a7e4-c140b1060b7b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:31.659971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445977b8-9ed2-4ded-89b3-e423f1a0f5d9 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:31.686496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a11dfe-9635-41a2-a7e4-c140b1060b7b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:31.718322 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee76ff9-646b-4066-ab8a-c080b9d703b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:31.719401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76ff9-646b-4066-ab8a-c080b9d703b1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.719830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76ff9-646b-4066-ab8a-c080b9d703b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.720243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76ff9-646b-4066-ab8a-c080b9d703b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.732937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee76ff9-646b-4066-ab8a-c080b9d703b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:31.733348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac1439-23a7-47c4-b0b2-58f9169d27bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:31.734281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1439-23a7-47c4-b0b2-58f9169d27bb None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.734634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1439-23a7-47c4-b0b2-58f9169d27bb None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.734974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1439-23a7-47c4-b0b2-58f9169d27bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-eee76ff9-646b-4066-ab8a-c080b9d703b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:31.741475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:31.742639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:31.744232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:31.746746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 341/688] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:31.751612 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac1439-23a7-47c4-b0b2-58f9169d27bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:31.753068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac1439-23a7-47c4-b0b2-58f9169d27bb None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:31.754353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee76ff9-646b-4066-ab8a-c080b9d703b1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-7bac1439-23a7-47c4-b0b2-58f9169d27bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:31.775492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:31.776467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:31.778055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:31.778055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:31.778055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:31.778055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:31.778055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 348/689] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:31.782228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac1439-23a7-47c4-b0b2-58f9169d27bb None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:31.875208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee76ff9-646b-4066-ab8a-c080b9d703b1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:31.896910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac1439-23a7-47c4-b0b2-58f9169d27bb None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:31.908008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5f0a1-e36d-452f-8847-23e173615068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:31.908682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5f0a1-e36d-452f-8847-23e173615068 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.909015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5f0a1-e36d-452f-8847-23e173615068 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.909296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5f0a1-e36d-452f-8847-23e173615068 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.910193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5f0a1-e36d-452f-8847-23e173615068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:31.910403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5f0a1-e36d-452f-8847-23e173615068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:31.911982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5f0a1-e36d-452f-8847-23e173615068 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:31.925111 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 342/690] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:31.939773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5f0a1-e36d-452f-8847-23e173615068 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:31.942449 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e204695-95d8-4368-bbd9-200e4235ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:31.943343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e204695-95d8-4368-bbd9-200e4235ae93 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:31.943956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e204695-95d8-4368-bbd9-200e4235ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:31.944434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e204695-95d8-4368-bbd9-200e4235ae93 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:31.945345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e204695-95d8-4368-bbd9-200e4235ae93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:31.945876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e204695-95d8-4368-bbd9-200e4235ae93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:31.947464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e204695-95d8-4368-bbd9-200e4235ae93 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:31.960836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 349/691] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:31.968179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e204695-95d8-4368-bbd9-200e4235ae93 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:32.090033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e204695-95d8-4368-bbd9-200e4235ae93 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:32.129993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68494b13-b7c8-4461-8414-cf134600ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:32.131043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68494b13-b7c8-4461-8414-cf134600ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:32.131531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68494b13-b7c8-4461-8414-cf134600ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:32.132008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68494b13-b7c8-4461-8414-cf134600ffb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:32.145146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68494b13-b7c8-4461-8414-cf134600ffb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:32.147827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68494b13-b7c8-4461-8414-cf134600ffb6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:32.163010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5f0a1-e36d-452f-8847-23e173615068 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-68494b13-b7c8-4461-8414-cf134600ffb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:32.173831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:32.174752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:32.175629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:32.175629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:32.175629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:32.175629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:32.175629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:32.175629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:32.175629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:32.175629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:32.189135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 350/692] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:32.191892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68494b13-b7c8-4461-8414-cf134600ffb6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:32.222296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0c16d-ab4d-429b-8abe-884b9f3a4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:32.223442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c16d-ab4d-429b-8abe-884b9f3a4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:32.223944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c16d-ab4d-429b-8abe-884b9f3a4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:32.224417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c16d-ab4d-429b-8abe-884b9f3a4ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:32.237039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0c16d-ab4d-429b-8abe-884b9f3a4ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:32.238937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0c16d-ab4d-429b-8abe-884b9f3a4ac7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-76c0c16d-ab4d-429b-8abe-884b9f3a4ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:32.272129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:32.273097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:32.274091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:32.274091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:32.274091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:32.274091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:32.282752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 343/693] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:32.284659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0c16d-ab4d-429b-8abe-884b9f3a4ac7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:32.398012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0c16d-ab4d-429b-8abe-884b9f3a4ac7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:32.406497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68494b13-b7c8-4461-8414-cf134600ffb6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:32.441596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe8a5c-6fdc-4b9a-b08b-1fdbdd68114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:32.442628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe8a5c-6fdc-4b9a-b08b-1fdbdd68114d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:32.443119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe8a5c-6fdc-4b9a-b08b-1fdbdd68114d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:32.443596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe8a5c-6fdc-4b9a-b08b-1fdbdd68114d None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:32.444562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe8a5c-6fdc-4b9a-b08b-1fdbdd68114d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:32.445113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe8a5c-6fdc-4b9a-b08b-1fdbdd68114d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:32.447370 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe8a5c-6fdc-4b9a-b08b-1fdbdd68114d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:32.458695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935716-4038-4455-8eba-53c586bb3c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:32.459373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935716-4038-4455-8eba-53c586bb3c39 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:32.459657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935716-4038-4455-8eba-53c586bb3c39 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:32.459934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935716-4038-4455-8eba-53c586bb3c39 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:32.460661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935716-4038-4455-8eba-53c586bb3c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:32.465567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935716-4038-4455-8eba-53c586bb3c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:32.465567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935716-4038-4455-8eba-53c586bb3c39 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:32.466107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 351/694] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:32.469288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe8a5c-6fdc-4b9a-b08b-1fdbdd68114d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:32.497578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 344/695] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:32.512306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935716-4038-4455-8eba-53c586bb3c39 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:32.576575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe8a5c-6fdc-4b9a-b08b-1fdbdd68114d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:32.611296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc47593-00ec-4cbd-8cea-0027148152d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:32.612329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc47593-00ec-4cbd-8cea-0027148152d8 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:32.612838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc47593-00ec-4cbd-8cea-0027148152d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:32.613309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc47593-00ec-4cbd-8cea-0027148152d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:32.614358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc47593-00ec-4cbd-8cea-0027148152d8 None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=84eb7224717643288cc61f8e6f901543) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:32.614867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc47593-00ec-4cbd-8cea-0027148152d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:32.616473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc47593-00ec-4cbd-8cea-0027148152d8 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:32.629678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 352/696] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:32 2022] GET /identity/v3/role_assignments?user.id=84eb7224717643288cc61f8e6f901543&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:32.718810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935716-4038-4455-8eba-53c586bb3c39 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:32.779311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a931ed-44cb-4206-b95e-4d9770931639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:32.780134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a931ed-44cb-4206-b95e-4d9770931639 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:32.780418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a931ed-44cb-4206-b95e-4d9770931639 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:32.780694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a931ed-44cb-4206-b95e-4d9770931639 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:32.795625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a931ed-44cb-4206-b95e-4d9770931639 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:32.797902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a931ed-44cb-4206-b95e-4d9770931639 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-a6a931ed-44cb-4206-b95e-4d9770931639 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:32.816897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:32.817963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:32.819440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 345/697] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 12 18:46:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:32.826279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc47593-00ec-4cbd-8cea-0027148152d8 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:32.940907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc47593-00ec-4cbd-8cea-0027148152d8 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:32.958115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398492f-4e9a-4703-9a5b-feca6004a8f7 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:32.958416 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398492f-4e9a-4703-9a5b-feca6004a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:32.958689 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398492f-4e9a-4703-9a5b-feca6004a8f7 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:32.960269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 346/698] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:32.966785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dada1d-96ce-44c3-bffb-0e0f201bb6be None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:32.966785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dada1d-96ce-44c3-bffb-0e0f201bb6be None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:32.967116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dada1d-96ce-44c3-bffb-0e0f201bb6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:32.978430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a251-3818-4eea-91f3-e898667a2909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:32.979413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a251-3818-4eea-91f3-e898667a2909 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:32.979890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a251-3818-4eea-91f3-e898667a2909 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:32.980369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a251-3818-4eea-91f3-e898667a2909 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:32.981398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664a251-3818-4eea-91f3-e898667a2909 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:32.981934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664a251-3818-4eea-91f3-e898667a2909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:32.983624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664a251-3818-4eea-91f3-e898667a2909 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:32.988260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d8dada1d-96ce-44c3-bffb-0e0f201bb6be None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:32.989481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d8dada1d-96ce-44c3-bffb-0e0f201bb6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:33.002704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 353/699] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 12 18:46:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:33.008554 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a251-3818-4eea-91f3-e898667a2909 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:33.066777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 347/700] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:46:33.103521 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dada1d-96ce-44c3-bffb-0e0f201bb6be None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:33.120828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a251-3818-4eea-91f3-e898667a2909 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:33.163540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2094f-2269-451d-ba50-dc4ffc0593e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:33.167783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2094f-2269-451d-ba50-dc4ffc0593e2 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:33.167783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2094f-2269-451d-ba50-dc4ffc0593e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:33.167783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2094f-2269-451d-ba50-dc4ffc0593e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:33.221611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dada1d-96ce-44c3-bffb-0e0f201bb6be None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:33.238978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2094f-2269-451d-ba50-dc4ffc0593e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:33.240358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2094f-2269-451d-ba50-dc4ffc0593e2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:33.256043 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bfe63-7c56-452f-8619-995114a24390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:33.256846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bfe63-7c56-452f-8619-995114a24390 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:33.257130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bfe63-7c56-452f-8619-995114a24390 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:33.257406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bfe63-7c56-452f-8619-995114a24390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:33.268319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bfe63-7c56-452f-8619-995114a24390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:33.269813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bfe63-7c56-452f-8619-995114a24390 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e98bfe63-7c56-452f-8619-995114a24390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:33.288255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:33.289197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:33.290662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:33.290662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:33.290662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:33.290662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:33.290662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 348/701] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:33.295404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bfe63-7c56-452f-8619-995114a24390 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:33.353073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 354/702] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:46:33.360017 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2094f-2269-451d-ba50-dc4ffc0593e2 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:33.465958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bfe63-7c56-452f-8619-995114a24390 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:33.519261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da66cf9-a5b6-4842-8d02-3abd30442bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:33.519618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da66cf9-a5b6-4842-8d02-3abd30442bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:33.519908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da66cf9-a5b6-4842-8d02-3abd30442bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:33.520184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da66cf9-a5b6-4842-8d02-3abd30442bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:33.520913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da66cf9-a5b6-4842-8d02-3abd30442bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:33.521208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da66cf9-a5b6-4842-8d02-3abd30442bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:33.522613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da66cf9-a5b6-4842-8d02-3abd30442bd0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:33.529667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2094f-2269-451d-ba50-dc4ffc0593e2 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:33.535478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 349/703] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:33.536793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56566a17-1c17-4725-bcda-5c1831489b4e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:33.537081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56566a17-1c17-4725-bcda-5c1831489b4e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:33.537355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56566a17-1c17-4725-bcda-5c1831489b4e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:33.542766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 350/704] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:33.542766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56566a17-1c17-4725-bcda-5c1831489b4e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:33.570387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab14b1-60e6-419c-820f-af0069f9ed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:33.572114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab14b1-60e6-419c-820f-af0069f9ed42 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:33.572605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab14b1-60e6-419c-820f-af0069f9ed42 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:33.573069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab14b1-60e6-419c-820f-af0069f9ed42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:33.583581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab14b1-60e6-419c-820f-af0069f9ed42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:33.585800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab14b1-60e6-419c-820f-af0069f9ed42 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-58ab14b1-60e6-419c-820f-af0069f9ed42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:33.604252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:33.605189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:33.606514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:33.606514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:33.606514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:33.606514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:33.612703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 355/705] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:33.614309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ab8e-58bb-4f29-8310-b75b0ad6820a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:33.614792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ab8e-58bb-4f29-8310-b75b0ad6820a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:33.615257 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ab8e-58bb-4f29-8310-b75b0ad6820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:33.632189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2727ab8e-58bb-4f29-8310-b75b0ad6820a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:33.634276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2727ab8e-58bb-4f29-8310-b75b0ad6820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:33.642634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56566a17-1c17-4725-bcda-5c1831489b4e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:33.678696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c79d44-4e1a-474d-9023-97e45c5171e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:33.679410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c79d44-4e1a-474d-9023-97e45c5171e2 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:33.679703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c79d44-4e1a-474d-9023-97e45c5171e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:33.680139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c79d44-4e1a-474d-9023-97e45c5171e2 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:33.681228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c79d44-4e1a-474d-9023-97e45c5171e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:33.682712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c79d44-4e1a-474d-9023-97e45c5171e2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:33.703836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 351/706] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:46:33 2022] POST /identity/v3/users => generated 254 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:33.704781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c79d44-4e1a-474d-9023-97e45c5171e2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:33.714079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 356/707] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:33.728701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ab8e-58bb-4f29-8310-b75b0ad6820a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:33.815411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c79d44-4e1a-474d-9023-97e45c5171e2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:33.859983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ab8e-58bb-4f29-8310-b75b0ad6820a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:33.871921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0671a-5379-4687-a7b5-59dff2bc6f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:33.872610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0671a-5379-4687-a7b5-59dff2bc6f49 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:33.872890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0671a-5379-4687-a7b5-59dff2bc6f49 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:33.873163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0671a-5379-4687-a7b5-59dff2bc6f49 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:33.873940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0671a-5379-4687-a7b5-59dff2bc6f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:33.874306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0671a-5379-4687-a7b5-59dff2bc6f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:33.875769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0671a-5379-4687-a7b5-59dff2bc6f49 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:33.903731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 352/708] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:33.909546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0671a-5379-4687-a7b5-59dff2bc6f49 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:33.934112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eb987-3e68-4ba0-aade-baef45f292a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:33.934945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb987-3e68-4ba0-aade-baef45f292a5 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:33.935226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb987-3e68-4ba0-aade-baef45f292a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:33.935499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb987-3e68-4ba0-aade-baef45f292a5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:33.936161 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eb987-3e68-4ba0-aade-baef45f292a5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:33.937563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eb987-3e68-4ba0-aade-baef45f292a5 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-0c9eb987-3e68-4ba0-aade-baef45f292a5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:33.961601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:33.962649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:33.963633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 357/709] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 12 18:46:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:33.967492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eb987-3e68-4ba0-aade-baef45f292a5 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:34.048679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0671a-5379-4687-a7b5-59dff2bc6f49 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:34.073739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eb987-3e68-4ba0-aade-baef45f292a5 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:34.088489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a6adc-7fc8-4770-8210-ddf92e682858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:34.089657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a6adc-7fc8-4770-8210-ddf92e682858 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.089657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a6adc-7fc8-4770-8210-ddf92e682858 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.089914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a6adc-7fc8-4770-8210-ddf92e682858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.096926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a6adc-7fc8-4770-8210-ddf92e682858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:34.098424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a6adc-7fc8-4770-8210-ddf92e682858 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:34.112349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f887c-f8e9-41ce-bf76-45c8fbf66281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:34.113335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f887c-f8e9-41ce-bf76-45c8fbf66281 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.113844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f887c-f8e9-41ce-bf76-45c8fbf66281 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-171a6adc-7fc8-4770-8210-ddf92e682858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:34.114313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:34.115179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:34.116075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:34.116075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:34.116075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:34.116075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:34.116075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:34.116075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:34.116075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:34.116075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:34.116648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f887c-f8e9-41ce-bf76-45c8fbf66281 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.117505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f887c-f8e9-41ce-bf76-45c8fbf66281 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:34.118465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f887c-f8e9-41ce-bf76-45c8fbf66281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:34.119905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f887c-f8e9-41ce-bf76-45c8fbf66281 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:34.120580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 353/710] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:34.122973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cd76d-6e5d-4eaa-9113-54819d793757 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.123202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cd76d-6e5d-4eaa-9113-54819d793757 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.123486 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cd76d-6e5d-4eaa-9113-54819d793757 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.124818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 354/711] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:34.125516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cd76d-6e5d-4eaa-9113-54819d793757 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:34.130839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 358/712] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 12 18:46:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:34.131960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fda91-5828-40c8-b1bc-55b5365cada5 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.132214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fda91-5828-40c8-b1bc-55b5365cada5 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.132484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fda91-5828-40c8-b1bc-55b5365cada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.150881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-0d5fda91-5828-40c8-b1bc-55b5365cada5 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:34.152346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0d5fda91-5828-40c8-b1bc-55b5365cada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:34.235030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 359/713] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:34.236216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fda91-5828-40c8-b1bc-55b5365cada5 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:34.248663 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cd76d-6e5d-4eaa-9113-54819d793757 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:34.282418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccdb4-b477-4627-819a-d683fff7d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:34.283130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccdb4-b477-4627-819a-d683fff7d644 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.283635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccdb4-b477-4627-819a-d683fff7d644 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.283766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccdb4-b477-4627-819a-d683fff7d644 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.284455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ccdb4-b477-4627-819a-d683fff7d644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:34.284752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ccdb4-b477-4627-819a-d683fff7d644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:34.289548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ccdb4-b477-4627-819a-d683fff7d644 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:34.304570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 355/714] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:34.306294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccdb4-b477-4627-819a-d683fff7d644 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:34.362120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fda91-5828-40c8-b1bc-55b5365cada5 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:34.398603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b487c-c40a-4533-a9fc-731d8dbf9c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:34.400177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b487c-c40a-4533-a9fc-731d8dbf9c86 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.400692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b487c-c40a-4533-a9fc-731d8dbf9c86 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.401168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b487c-c40a-4533-a9fc-731d8dbf9c86 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.402126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b487c-c40a-4533-a9fc-731d8dbf9c86 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:34.402634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b487c-c40a-4533-a9fc-731d8dbf9c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:34.404210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b487c-c40a-4533-a9fc-731d8dbf9c86 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:34.408417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccdb4-b477-4627-819a-d683fff7d644 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:34.410745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 360/715] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 12 18:46:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:34.411823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b487c-c40a-4533-a9fc-731d8dbf9c86 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:34.481774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983885f8-d94c-4913-85a1-022cb4851b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:34.482643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983885f8-d94c-4913-85a1-022cb4851b9f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.482921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983885f8-d94c-4913-85a1-022cb4851b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.483192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983885f8-d94c-4913-85a1-022cb4851b9f None admin] PATH_INFO: `/v3/services/network` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.484131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983885f8-d94c-4913-85a1-022cb4851b9f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:34.485363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983885f8-d94c-4913-85a1-022cb4851b9f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-983885f8-d94c-4913-85a1-022cb4851b9f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:34.511288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:34.512361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:34.513218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 356/716] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:34 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:34.520628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983885f8-d94c-4913-85a1-022cb4851b9f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:34.540633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b487c-c40a-4533-a9fc-731d8dbf9c86 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:34.607982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077580b-6dfc-4dc1-8f21-33bc2408faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:34.608629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077580b-6dfc-4dc1-8f21-33bc2408faee None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.608908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077580b-6dfc-4dc1-8f21-33bc2408faee None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.609180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077580b-6dfc-4dc1-8f21-33bc2408faee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.610032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077580b-6dfc-4dc1-8f21-33bc2408faee None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=e2e41b41f355446c8462fafcd91c183f) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:34.610342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077580b-6dfc-4dc1-8f21-33bc2408faee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:34.611774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077580b-6dfc-4dc1-8f21-33bc2408faee None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:34.620880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 361/717] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:34 2022] GET /identity/v3/role_assignments?user.id=e2e41b41f355446c8462fafcd91c183f&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=d03e020b3fb34446bbf5893b28904483 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:34.687396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983885f8-d94c-4913-85a1-022cb4851b9f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:34.725310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0e79b-240d-4f38-8ab3-03705e867113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:34.726111 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0e79b-240d-4f38-8ab3-03705e867113 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.726392 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0e79b-240d-4f38-8ab3-03705e867113 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.726662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0e79b-240d-4f38-8ab3-03705e867113 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.727996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0e79b-240d-4f38-8ab3-03705e867113 None admin] RBAC: Adding query filter params (name=network) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:34.728303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0e79b-240d-4f38-8ab3-03705e867113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:34.729739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0e79b-240d-4f38-8ab3-03705e867113 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:34.735035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 357/718] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:46:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:34.740676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077580b-6dfc-4dc1-8f21-33bc2408faee None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:34.849894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077580b-6dfc-4dc1-8f21-33bc2408faee None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:34.890531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50800b0-ca4b-497b-a64e-3a8d37e05124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:34.891128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50800b0-ca4b-497b-a64e-3a8d37e05124 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:34.891407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50800b0-ca4b-497b-a64e-3a8d37e05124 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:34.891681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50800b0-ca4b-497b-a64e-3a8d37e05124 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:34.892384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50800b0-ca4b-497b-a64e-3a8d37e05124 None admin] RBAC: Adding query filter params (type=network) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:34.892688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50800b0-ca4b-497b-a64e-3a8d37e05124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:34.894084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50800b0-ca4b-497b-a64e-3a8d37e05124 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:34.901893 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 362/719] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:46:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:35.782202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118b0d-6476-4b31-924c-18faa90aaae6 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:35.782202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118b0d-6476-4b31-924c-18faa90aaae6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:35.782202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118b0d-6476-4b31-924c-18faa90aaae6 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:35.783327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 358/720] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:35.788912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82ac0a-9c34-4756-b58d-81c8b8387322 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:35.790252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82ac0a-9c34-4756-b58d-81c8b8387322 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:35.790756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82ac0a-9c34-4756-b58d-81c8b8387322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:35.815881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-df82ac0a-9c34-4756-b58d-81c8b8387322 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:35.817409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-df82ac0a-9c34-4756-b58d-81c8b8387322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:35.901698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 363/721] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 18:46:35.926001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59118b0d-6476-4b31-924c-18faa90aaae6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:36.052879 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59118b0d-6476-4b31-924c-18faa90aaae6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:36.092632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f8205-3366-4ae2-b3b7-c6131f90fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:36.093809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f8205-3366-4ae2-b3b7-c6131f90fecb None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:36.094299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f8205-3366-4ae2-b3b7-c6131f90fecb None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:36.094798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f8205-3366-4ae2-b3b7-c6131f90fecb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:36.119654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f8205-3366-4ae2-b3b7-c6131f90fecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-623f8205-3366-4ae2-b3b7-c6131f90fecb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:36.127774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:36.128719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:36.134097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:36.137139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 359/722] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:36.143066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82ac0a-9c34-4756-b58d-81c8b8387322 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:36.244084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82ac0a-9c34-4756-b58d-81c8b8387322 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:36.287728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c272c0-4b0d-4aa3-82ac-cd27c9e4736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:36.288755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c272c0-4b0d-4aa3-82ac-cd27c9e4736c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:36.289252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c272c0-4b0d-4aa3-82ac-cd27c9e4736c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:36.289824 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c272c0-4b0d-4aa3-82ac-cd27c9e4736c None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:36.290852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c272c0-4b0d-4aa3-82ac-cd27c9e4736c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:36.291374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c272c0-4b0d-4aa3-82ac-cd27c9e4736c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:36.292972 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c272c0-4b0d-4aa3-82ac-cd27c9e4736c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:36.310747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 364/723] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:36.316439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f8205-3366-4ae2-b3b7-c6131f90fecb None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:36.427399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f8205-3366-4ae2-b3b7-c6131f90fecb None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:36.468547 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb2739-80ba-4383-955a-dbe7c2f65a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:36.469722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb2739-80ba-4383-955a-dbe7c2f65a59 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:36.470230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb2739-80ba-4383-955a-dbe7c2f65a59 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:36.470726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb2739-80ba-4383-955a-dbe7c2f65a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:36.482189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb2739-80ba-4383-955a-dbe7c2f65a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:36.484023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb2739-80ba-4383-955a-dbe7c2f65a59 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-f7bb2739-80ba-4383-955a-dbe7c2f65a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:36.509618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:36.510603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:36.511562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:36.511562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:36.511562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:36.511562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:36.513878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 360/724] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:36.519532 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c272c0-4b0d-4aa3-82ac-cd27c9e4736c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:36.613604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c345c0e-4a38-4e83-a6e7-e26a680b5cc5 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:36.613933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c345c0e-4a38-4e83-a6e7-e26a680b5cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:36.614155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c345c0e-4a38-4e83-a6e7-e26a680b5cc5 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:36.616821 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 361/725] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:36.621590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ffbcc-a8b1-40ef-809f-809792523312 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:36.621888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ffbcc-a8b1-40ef-809f-809792523312 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:36.622163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ffbcc-a8b1-40ef-809f-809792523312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:36.666798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-df6ffbcc-a8b1-40ef-809f-809792523312 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:36.668052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-df6ffbcc-a8b1-40ef-809f-809792523312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:36.754179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c272c0-4b0d-4aa3-82ac-cd27c9e4736c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:36.788114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550966c-a1b3-452b-a0f9-836b183f7e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:36.788775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550966c-a1b3-452b-a0f9-836b183f7e6b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:36.789057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550966c-a1b3-452b-a0f9-836b183f7e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:36.789641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550966c-a1b3-452b-a0f9-836b183f7e6b None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:36.790097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550966c-a1b3-452b-a0f9-836b183f7e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:36.790404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550966c-a1b3-452b-a0f9-836b183f7e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:36.791773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550966c-a1b3-452b-a0f9-836b183f7e6b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:36.803837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 365/726] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:36.810232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550966c-a1b3-452b-a0f9-836b183f7e6b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:36.834617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 362/727] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:36.866654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ffbcc-a8b1-40ef-809f-809792523312 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:36.917053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550966c-a1b3-452b-a0f9-836b183f7e6b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:36.956908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eff491-e33d-48f6-94c2-69a906f34fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:36.957729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eff491-e33d-48f6-94c2-69a906f34fcd None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:36.958009 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eff491-e33d-48f6-94c2-69a906f34fcd None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:36.958280 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eff491-e33d-48f6-94c2-69a906f34fcd None admin] PATH_INFO: `/v3/users/swift` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:36.970663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eff491-e33d-48f6-94c2-69a906f34fcd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:36.970663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eff491-e33d-48f6-94c2-69a906f34fcd None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-84eff491-e33d-48f6-94c2-69a906f34fcd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:36.986644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:36.987643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:36.988626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 366/728] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:36.994652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eff491-e33d-48f6-94c2-69a906f34fcd None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:37.072484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ffbcc-a8b1-40ef-809f-809792523312 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:37.138155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c99ed-d815-4b15-83d6-085664b87ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:37.138840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c99ed-d815-4b15-83d6-085664b87ec3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.139115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c99ed-d815-4b15-83d6-085664b87ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.139389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c99ed-d815-4b15-83d6-085664b87ec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.159462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c99ed-d815-4b15-83d6-085664b87ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d27c99ed-d815-4b15-83d6-085664b87ec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:37.178903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:37.179896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:37.182132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 363/729] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:37.186390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c99ed-d815-4b15-83d6-085664b87ec3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:37.204840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eff491-e33d-48f6-94c2-69a906f34fcd None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:37.248404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851cfd-b7aa-4809-8014-5c7b1c4161c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:37.249072 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851cfd-b7aa-4809-8014-5c7b1c4161c9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.249350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851cfd-b7aa-4809-8014-5c7b1c4161c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.249649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851cfd-b7aa-4809-8014-5c7b1c4161c9 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.250821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851cfd-b7aa-4809-8014-5c7b1c4161c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:37.251401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851cfd-b7aa-4809-8014-5c7b1c4161c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:37.252816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851cfd-b7aa-4809-8014-5c7b1c4161c9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:37.271894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 367/730] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 12 18:46:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:37.276555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851cfd-b7aa-4809-8014-5c7b1c4161c9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:37.362722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c99ed-d815-4b15-83d6-085664b87ec3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:37.395901 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851cfd-b7aa-4809-8014-5c7b1c4161c9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:37.396539 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802dde0-1511-4897-8010-77a783a441bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:37.397207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802dde0-1511-4897-8010-77a783a441bd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.397478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802dde0-1511-4897-8010-77a783a441bd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.397792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802dde0-1511-4897-8010-77a783a441bd None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.398531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802dde0-1511-4897-8010-77a783a441bd None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:37.398833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802dde0-1511-4897-8010-77a783a441bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:37.400709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802dde0-1511-4897-8010-77a783a441bd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:37.409181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 364/731] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:37.410586 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd6f5d-35f6-45cb-a6a5-c196061d8552 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.410872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd6f5d-35f6-45cb-a6a5-c196061d8552 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.411146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd6f5d-35f6-45cb-a6a5-c196061d8552 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.412358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 365/732] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:37.415798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd6f5d-35f6-45cb-a6a5-c196061d8552 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:37.441312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77dd99-26a8-4eab-8089-0a98361692bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:37.442445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77dd99-26a8-4eab-8089-0a98361692bb None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.442747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77dd99-26a8-4eab-8089-0a98361692bb None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.443023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77dd99-26a8-4eab-8089-0a98361692bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.521904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd6f5d-35f6-45cb-a6a5-c196061d8552 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:37.529113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77dd99-26a8-4eab-8089-0a98361692bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:37.530587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77dd99-26a8-4eab-8089-0a98361692bb None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:37.556549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d61536-1057-4a22-95ad-ea0b367121c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:37.557329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61536-1057-4a22-95ad-ea0b367121c5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.557639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61536-1057-4a22-95ad-ea0b367121c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.557912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61536-1057-4a22-95ad-ea0b367121c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.567607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d61536-1057-4a22-95ad-ea0b367121c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:37.569035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d61536-1057-4a22-95ad-ea0b367121c5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-98d61536-1057-4a22-95ad-ea0b367121c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:37.588717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:37.589913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:37.591024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:37.591024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:37.591024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:37.591024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:37.591024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 366/733] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:37.592951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e0123-635f-45fa-81e4-2e6c420177f8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.592951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e0123-635f-45fa-81e4-2e6c420177f8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.592951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e0123-635f-45fa-81e4-2e6c420177f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.610336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7c0e0123-635f-45fa-81e4-2e6c420177f8 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:37.611548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7c0e0123-635f-45fa-81e4-2e6c420177f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:37.635896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 368/734] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 18:46:37.637209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b054f-3dbe-46c3-9fa0-274dcc9f1bf2 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.637488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b054f-3dbe-46c3-9fa0-274dcc9f1bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.637840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b054f-3dbe-46c3-9fa0-274dcc9f1bf2 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.639212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 369/735] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:37.639741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b054f-3dbe-46c3-9fa0-274dcc9f1bf2 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:37.683847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 367/736] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:37.684796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e0123-635f-45fa-81e4-2e6c420177f8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:37.757615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b054f-3dbe-46c3-9fa0-274dcc9f1bf2 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:37.781038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e0123-635f-45fa-81e4-2e6c420177f8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:37.792623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bb028-2956-4713-8747-14f30c05431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:37.793261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bb028-2956-4713-8747-14f30c05431b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.793571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bb028-2956-4713-8747-14f30c05431b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.793831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bb028-2956-4713-8747-14f30c05431b None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.794546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bb028-2956-4713-8747-14f30c05431b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:37.794846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bb028-2956-4713-8747-14f30c05431b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:37.796549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bb028-2956-4713-8747-14f30c05431b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:37.807403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 370/737] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:37.808559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b8851-5dab-4b25-8e38-9be3e9c26793 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.808843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b8851-5dab-4b25-8e38-9be3e9c26793 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.809112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b8851-5dab-4b25-8e38-9be3e9c26793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.814309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161eb5f8-37e8-4c74-ba4b-02ddbaf87d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:37.815074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eb5f8-37e8-4c74-ba4b-02ddbaf87d10 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.815354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eb5f8-37e8-4c74-ba4b-02ddbaf87d10 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.815625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eb5f8-37e8-4c74-ba4b-02ddbaf87d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.824915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-808b8851-5dab-4b25-8e38-9be3e9c26793 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:37.825817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eb5f8-37e8-4c74-ba4b-02ddbaf87d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:37.826111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-808b8851-5dab-4b25-8e38-9be3e9c26793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:37.827231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eb5f8-37e8-4c74-ba4b-02ddbaf87d10 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-161eb5f8-37e8-4c74-ba4b-02ddbaf87d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:37.844366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:37.845921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:37.847084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:37.847084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:37.847084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:37.847084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:37.847084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 368/738] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:37.847084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161eb5f8-37e8-4c74-ba4b-02ddbaf87d10 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:37.890367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 371/739] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:37.891651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a0b23-2219-4c67-a325-2e62bf11ae55 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.891936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a0b23-2219-4c67-a325-2e62bf11ae55 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.892204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a0b23-2219-4c67-a325-2e62bf11ae55 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.897398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 372/740] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:37.897398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a0b23-2219-4c67-a325-2e62bf11ae55 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:37.943492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161eb5f8-37e8-4c74-ba4b-02ddbaf87d10 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:37.973883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831e187-e57f-4e8c-a350-005ffd9e77ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:37.974530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831e187-e57f-4e8c-a350-005ffd9e77ea None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:37.974806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831e187-e57f-4e8c-a350-005ffd9e77ea None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:37.975077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831e187-e57f-4e8c-a350-005ffd9e77ea None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:37.975784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831e187-e57f-4e8c-a350-005ffd9e77ea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:37.977692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831e187-e57f-4e8c-a350-005ffd9e77ea None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:37.991123 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 369/741] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:46:37 2022] POST /identity/v3/services => generated 251 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:37.991917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831e187-e57f-4e8c-a350-005ffd9e77ea None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.013037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a0b23-2219-4c67-a325-2e62bf11ae55 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:38.057605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac297506-17ae-4eff-8c0a-a0787a13f2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:38.058440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297506-17ae-4eff-8c0a-a0787a13f2d3 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.058725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297506-17ae-4eff-8c0a-a0787a13f2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.058994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297506-17ae-4eff-8c0a-a0787a13f2d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.066868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac297506-17ae-4eff-8c0a-a0787a13f2d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:38.068380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac297506-17ae-4eff-8c0a-a0787a13f2d3 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-ac297506-17ae-4eff-8c0a-a0787a13f2d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:38.084474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:38.085555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:46:38.086641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:38.090191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 373/742] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:46:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:38.091967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5cca-9339-4ba7-a6b4-7ee2c3542fe4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.092265 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5cca-9339-4ba7-a6b4-7ee2c3542fe4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.092524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5cca-9339-4ba7-a6b4-7ee2c3542fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.103007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831e187-e57f-4e8c-a350-005ffd9e77ea None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:38.109918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-eb7b5cca-9339-4ba7-a6b4-7ee2c3542fe4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:38.111122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-eb7b5cca-9339-4ba7-a6b4-7ee2c3542fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:38.140575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6c2c1-b13a-4076-8a91-363c7c232b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:38.141259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6c2c1-b13a-4076-8a91-363c7c232b27 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.141574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6c2c1-b13a-4076-8a91-363c7c232b27 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.142092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6c2c1-b13a-4076-8a91-363c7c232b27 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.142576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6c2c1-b13a-4076-8a91-363c7c232b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:38.142885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6c2c1-b13a-4076-8a91-363c7c232b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:38.144264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6c2c1-b13a-4076-8a91-363c7c232b27 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:38.162248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 370/743] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:38.162248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6c2c1-b13a-4076-8a91-363c7c232b27 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.194071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 374/744] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 18:46:38.194430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5cca-9339-4ba7-a6b4-7ee2c3542fe4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.274355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6c2c1-b13a-4076-8a91-363c7c232b27 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:38.295083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5cca-9339-4ba7-a6b4-7ee2c3542fe4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:38.307873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfcf52-919b-40d6-a19d-cb956f5d7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:38.308666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfcf52-919b-40d6-a19d-cb956f5d7b1b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.308950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfcf52-919b-40d6-a19d-cb956f5d7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.309228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfcf52-919b-40d6-a19d-cb956f5d7b1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.319438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfcf52-919b-40d6-a19d-cb956f5d7b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-57dfcf52-919b-40d6-a19d-cb956f5d7b1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:38.327070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:38.328010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:38.328871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 371/745] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:38.330266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfcf52-919b-40d6-a19d-cb956f5d7b1b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.337760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b261-cd31-47d7-aa33-6ff32c88937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:38.338440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b261-cd31-47d7-aa33-6ff32c88937b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.338724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b261-cd31-47d7-aa33-6ff32c88937b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.338998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b261-cd31-47d7-aa33-6ff32c88937b None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.340261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415b261-cd31-47d7-aa33-6ff32c88937b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:38.340575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415b261-cd31-47d7-aa33-6ff32c88937b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:38.342729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415b261-cd31-47d7-aa33-6ff32c88937b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:38.373707 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 375/746] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 12 18:46:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:38.374593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b261-cd31-47d7-aa33-6ff32c88937b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.432793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfcf52-919b-40d6-a19d-cb956f5d7b1b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:38.467015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28accf5a-1f34-4944-b363-dc63fc3d1e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:38.467742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28accf5a-1f34-4944-b363-dc63fc3d1e8a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.468022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28accf5a-1f34-4944-b363-dc63fc3d1e8a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.468299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28accf5a-1f34-4944-b363-dc63fc3d1e8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.470289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b261-cd31-47d7-aa33-6ff32c88937b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:38.474910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28accf5a-1f34-4944-b363-dc63fc3d1e8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:38.476346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28accf5a-1f34-4944-b363-dc63fc3d1e8a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-28accf5a-1f34-4944-b363-dc63fc3d1e8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:38.490649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:38.491613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:38.493057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:38.493057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:38.493057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:38.493057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:38.493057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:38.493057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:38.493057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:38.493057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:38.493057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 372/747] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:38.494257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28accf5a-1f34-4944-b363-dc63fc3d1e8a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.507521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460dae3-d5c6-4304-bdde-ebcdf1ffdb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:38.508854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460dae3-d5c6-4304-bdde-ebcdf1ffdb84 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.509501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460dae3-d5c6-4304-bdde-ebcdf1ffdb84 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.509501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460dae3-d5c6-4304-bdde-ebcdf1ffdb84 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.510358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460dae3-d5c6-4304-bdde-ebcdf1ffdb84 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:38.511722 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460dae3-d5c6-4304-bdde-ebcdf1ffdb84 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:38.525982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 376/748] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:46:38 2022] POST /identity/v3/services => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:38.526855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460dae3-d5c6-4304-bdde-ebcdf1ffdb84 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.621050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28accf5a-1f34-4944-b363-dc63fc3d1e8a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:38.661358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460dae3-d5c6-4304-bdde-ebcdf1ffdb84 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:38.666006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe5f6-eeba-4fff-8acb-85ebe6961376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:38.668067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe5f6-eeba-4fff-8acb-85ebe6961376 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.669596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe5f6-eeba-4fff-8acb-85ebe6961376 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.670026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe5f6-eeba-4fff-8acb-85ebe6961376 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.670946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe5f6-eeba-4fff-8acb-85ebe6961376 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:38.673838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe5f6-eeba-4fff-8acb-85ebe6961376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:38.675442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe5f6-eeba-4fff-8acb-85ebe6961376 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:38.685718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 373/749] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:38.686916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe5f6-eeba-4fff-8acb-85ebe6961376 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.710835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d219c-a4e0-4c5d-84ef-0c3441b4fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:38.711784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d219c-a4e0-4c5d-84ef-0c3441b4fef8 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.712207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d219c-a4e0-4c5d-84ef-0c3441b4fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.712620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d219c-a4e0-4c5d-84ef-0c3441b4fef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.798502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d219c-a4e0-4c5d-84ef-0c3441b4fef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:38.800592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d219c-a4e0-4c5d-84ef-0c3441b4fef8 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:38.813924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe5f6-eeba-4fff-8acb-85ebe6961376 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:38.847605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9602d9-b7f9-4994-8fa0-9e1ea62aee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:38.848252 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9602d9-b7f9-4994-8fa0-9e1ea62aee2a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:38.848620 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9602d9-b7f9-4994-8fa0-9e1ea62aee2a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:38.848817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9602d9-b7f9-4994-8fa0-9e1ea62aee2a None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:38.849638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9602d9-b7f9-4994-8fa0-9e1ea62aee2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:38.849956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9602d9-b7f9-4994-8fa0-9e1ea62aee2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:38.851633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9602d9-b7f9-4994-8fa0-9e1ea62aee2a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:38.864721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 374/750] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:38.869653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9602d9-b7f9-4994-8fa0-9e1ea62aee2a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.907083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 377/751] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:46:38.908240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d219c-a4e0-4c5d-84ef-0c3441b4fef8 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:38.976195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9602d9-b7f9-4994-8fa0-9e1ea62aee2a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:39.009499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d219c-a4e0-4c5d-84ef-0c3441b4fef8 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:39.010458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977010a1-afd0-4e4a-a23d-73df3506c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:39.011359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977010a1-afd0-4e4a-a23d-73df3506c5ed None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:39.011534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977010a1-afd0-4e4a-a23d-73df3506c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:39.011810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977010a1-afd0-4e4a-a23d-73df3506c5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:39.022265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977010a1-afd0-4e4a-a23d-73df3506c5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:39.023708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977010a1-afd0-4e4a-a23d-73df3506c5ed None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-977010a1-afd0-4e4a-a23d-73df3506c5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:39.043512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:39.044608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:39.045976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:39.045976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:39.045976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:39.045976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:39.045976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 375/752] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:39.045976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977010a1-afd0-4e4a-a23d-73df3506c5ed None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:39.048477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822585c8-137d-4aca-87e6-864e2ef0a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:39.049403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822585c8-137d-4aca-87e6-864e2ef0a707 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:39.049859 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822585c8-137d-4aca-87e6-864e2ef0a707 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:39.050270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822585c8-137d-4aca-87e6-864e2ef0a707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:39.051229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822585c8-137d-4aca-87e6-864e2ef0a707 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=84eb7224717643288cc61f8e6f901543) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:39.051694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822585c8-137d-4aca-87e6-864e2ef0a707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:39.053257 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822585c8-137d-4aca-87e6-864e2ef0a707 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:39.059676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 378/753] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:38 2022] GET /identity/v3/role_assignments?user.id=84eb7224717643288cc61f8e6f901543&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=d03e020b3fb34446bbf5893b28904483 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:39.060628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822585c8-137d-4aca-87e6-864e2ef0a707 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:39.187696 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822585c8-137d-4aca-87e6-864e2ef0a707 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:39.228351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8c9e2-4bbd-43d5-89c3-378af5a186a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:39.229269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8c9e2-4bbd-43d5-89c3-378af5a186a7 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:39.229719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8c9e2-4bbd-43d5-89c3-378af5a186a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:39.230133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8c9e2-4bbd-43d5-89c3-378af5a186a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:39.232164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8c9e2-4bbd-43d5-89c3-378af5a186a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:39.232650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8c9e2-4bbd-43d5-89c3-378af5a186a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:39.235283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8c9e2-4bbd-43d5-89c3-378af5a186a7 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:39.260637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 379/754] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:39.268586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8c9e2-4bbd-43d5-89c3-378af5a186a7 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:39.308335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977010a1-afd0-4e4a-a23d-73df3506c5ed None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:39.348770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82cb6-dca5-4503-8b46-32d0a235c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:39.349862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82cb6-dca5-4503-8b46-32d0a235c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:39.350285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82cb6-dca5-4503-8b46-32d0a235c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:39.350697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82cb6-dca5-4503-8b46-32d0a235c6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:39.367751 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf82cb6-dca5-4503-8b46-32d0a235c6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:39.369963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf82cb6-dca5-4503-8b46-32d0a235c6d5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-bbf82cb6-dca5-4503-8b46-32d0a235c6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:39.400989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:39.402160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:39.403261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:39.403261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:39.403261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:39.403261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:39.405265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 376/755] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:39.414471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82cb6-dca5-4503-8b46-32d0a235c6d5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:39.437482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8c9e2-4bbd-43d5-89c3-378af5a186a7 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:39.472675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bd52d-2a42-4d90-b3ec-7d8cc59b4fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:39.473550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd52d-2a42-4d90-b3ec-7d8cc59b4fe5 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:39.473841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd52d-2a42-4d90-b3ec-7d8cc59b4fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:39.474206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd52d-2a42-4d90-b3ec-7d8cc59b4fe5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:39.481607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bd52d-2a42-4d90-b3ec-7d8cc59b4fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:39.483096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bd52d-2a42-4d90-b3ec-7d8cc59b4fe5 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-0d6bd52d-2a42-4d90-b3ec-7d8cc59b4fe5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:39.497670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:39.498626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:39.499986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 380/756] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 12 18:46:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:39.504574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bd52d-2a42-4d90-b3ec-7d8cc59b4fe5 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:39.530120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82cb6-dca5-4503-8b46-32d0a235c6d5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:39.574849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631bba2-5303-47b5-8529-f056434c828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:39.575454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631bba2-5303-47b5-8529-f056434c828e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:39.575739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631bba2-5303-47b5-8529-f056434c828e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:39.576020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631bba2-5303-47b5-8529-f056434c828e None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:39.576737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631bba2-5303-47b5-8529-f056434c828e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:39.577052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631bba2-5303-47b5-8529-f056434c828e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:39.578456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631bba2-5303-47b5-8529-f056434c828e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:39.607223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bd52d-2a42-4d90-b3ec-7d8cc59b4fe5 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:39.607970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 377/757] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:39.618559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631bba2-5303-47b5-8529-f056434c828e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:39.649719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e7669-18a9-4223-bd35-991dbff728db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:39.650395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e7669-18a9-4223-bd35-991dbff728db None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:39.650675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e7669-18a9-4223-bd35-991dbff728db None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:39.650948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e7669-18a9-4223-bd35-991dbff728db None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:39.652528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e7669-18a9-4223-bd35-991dbff728db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:39.652840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e7669-18a9-4223-bd35-991dbff728db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:39.654294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e7669-18a9-4223-bd35-991dbff728db None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:39.694402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 381/758] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 12 18:46:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:39.697512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e7669-18a9-4223-bd35-991dbff728db None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:39.811557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631bba2-5303-47b5-8529-f056434c828e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:39.855605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23702-e197-4fe4-9bc7-7c0a05d7506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:39.856349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23702-e197-4fe4-9bc7-7c0a05d7506e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:39.856589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23702-e197-4fe4-9bc7-7c0a05d7506e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:39.856859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23702-e197-4fe4-9bc7-7c0a05d7506e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:39.863187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e7669-18a9-4223-bd35-991dbff728db None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:39.868796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d23702-e197-4fe4-9bc7-7c0a05d7506e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:39.878401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d23702-e197-4fe4-9bc7-7c0a05d7506e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:39.899010 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a46b9-07ef-4b58-8ae1-84e2c87906cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:39.899866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a46b9-07ef-4b58-8ae1-84e2c87906cd None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:39.900150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a46b9-07ef-4b58-8ae1-84e2c87906cd None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:39.900428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a46b9-07ef-4b58-8ae1-84e2c87906cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-97d23702-e197-4fe4-9bc7-7c0a05d7506e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:39.905911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:39.906792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:39.908588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:39.908588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:39.908588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:39.908588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:39.908588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:39.908588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:39.908588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:39.908588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:39.908588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 378/759] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:39.911380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a46b9-07ef-4b58-8ae1-84e2c87906cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:39.912590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23702-e197-4fe4-9bc7-7c0a05d7506e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:39.912782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a46b9-07ef-4b58-8ae1-84e2c87906cd None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-954a46b9-07ef-4b58-8ae1-84e2c87906cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:39.932404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:39.934764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:39.937007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:39.937007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:39.937007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:39.937007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:39.937007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 382/760] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:39.939356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a46b9-07ef-4b58-8ae1-84e2c87906cd None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:40.020200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23702-e197-4fe4-9bc7-7c0a05d7506e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:40.066268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28e067-3e5e-4442-a5b5-d79f43bdeba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:40.066942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28e067-3e5e-4442-a5b5-d79f43bdeba8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:40.067231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28e067-3e5e-4442-a5b5-d79f43bdeba8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:40.067511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28e067-3e5e-4442-a5b5-d79f43bdeba8 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:40.068313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28e067-3e5e-4442-a5b5-d79f43bdeba8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:40.068624 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28e067-3e5e-4442-a5b5-d79f43bdeba8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:40.070105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28e067-3e5e-4442-a5b5-d79f43bdeba8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:40.071692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a46b9-07ef-4b58-8ae1-84e2c87906cd None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:40.095825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 379/761] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:40.101792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28e067-3e5e-4442-a5b5-d79f43bdeba8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:40.106765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d1c5a-dd1b-45b3-892d-78aff100c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:40.107372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d1c5a-dd1b-45b3-892d-78aff100c221 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:40.107655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d1c5a-dd1b-45b3-892d-78aff100c221 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:40.107934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d1c5a-dd1b-45b3-892d-78aff100c221 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:40.108657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d1c5a-dd1b-45b3-892d-78aff100c221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:40.108961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d1c5a-dd1b-45b3-892d-78aff100c221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:40.110358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d1c5a-dd1b-45b3-892d-78aff100c221 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:40.135027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 383/762] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:40.140858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d1c5a-dd1b-45b3-892d-78aff100c221 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:40.283676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d1c5a-dd1b-45b3-892d-78aff100c221 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:40.299952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28e067-3e5e-4442-a5b5-d79f43bdeba8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:40.318817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b223e-bd1f-4613-a8e0-c97f665ee4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:40.319641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b223e-bd1f-4613-a8e0-c97f665ee4cd None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:40.319928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b223e-bd1f-4613-a8e0-c97f665ee4cd None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:40.320208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b223e-bd1f-4613-a8e0-c97f665ee4cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:40.328135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b223e-bd1f-4613-a8e0-c97f665ee4cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:40.333555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b223e-bd1f-4613-a8e0-c97f665ee4cd None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-599b223e-bd1f-4613-a8e0-c97f665ee4cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:40.346909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:40.352374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 384/763] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:40.353292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b223e-bd1f-4613-a8e0-c97f665ee4cd None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:40.374289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1e917-9067-4e65-8db7-e0e1c2855b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:40.375276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1e917-9067-4e65-8db7-e0e1c2855b66 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:40.375764 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1e917-9067-4e65-8db7-e0e1c2855b66 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:40.376238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1e917-9067-4e65-8db7-e0e1c2855b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:40.377307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1e917-9067-4e65-8db7-e0e1c2855b66 None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=6cf36b056ece466ea23001b8d33c16a2) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:40.377845 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1e917-9067-4e65-8db7-e0e1c2855b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:40.379473 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1e917-9067-4e65-8db7-e0e1c2855b66 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:40.389658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 380/764] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:40 2022] GET /identity/v3/role_assignments?user.id=6cf36b056ece466ea23001b8d33c16a2&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:40.459386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b223e-bd1f-4613-a8e0-c97f665ee4cd None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:40.496701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4821b2c-d35c-4887-a3d5-729f9374a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:40.497368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821b2c-d35c-4887-a3d5-729f9374a182 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:40.497694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821b2c-d35c-4887-a3d5-729f9374a182 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:40.497975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821b2c-d35c-4887-a3d5-729f9374a182 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:40.498832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4821b2c-d35c-4887-a3d5-729f9374a182 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:40.499146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4821b2c-d35c-4887-a3d5-729f9374a182 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:40.500632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4821b2c-d35c-4887-a3d5-729f9374a182 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:40.510058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b12d03-079d-4cec-86f2-9e3d6903ccc7 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:40.510397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b12d03-079d-4cec-86f2-9e3d6903ccc7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:40.510614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b12d03-079d-4cec-86f2-9e3d6903ccc7 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:40.512307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 381/765] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:40.513834 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 385/766] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:40.518428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62439f17-f0f4-471c-8489-fa5baa030283 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:40.518706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62439f17-f0f4-471c-8489-fa5baa030283 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:40.518984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62439f17-f0f4-471c-8489-fa5baa030283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:40.519628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4821b2c-d35c-4887-a3d5-729f9374a182 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:40.562707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-62439f17-f0f4-471c-8489-fa5baa030283 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:40.564546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-62439f17-f0f4-471c-8489-fa5baa030283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:40.630237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4821b2c-d35c-4887-a3d5-729f9374a182 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:40.667793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c5226-9991-474c-b159-af7b43b0cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:40.668700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5226-9991-474c-b159-af7b43b0cf21 None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:40.668984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5226-9991-474c-b159-af7b43b0cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:40.669263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5226-9991-474c-b159-af7b43b0cf21 None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/e2e41b41f355446c8462fafcd91c183f/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:40.671664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c5226-9991-474c-b159-af7b43b0cf21 None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=e2e41b41f355446c8462fafcd91c183f, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:40.673120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c5226-9991-474c-b159-af7b43b0cf21 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:40.696213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 386/767] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:46:40 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/e2e41b41f355446c8462fafcd91c183f/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:40.730804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 382/768] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:40.765482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c5226-9991-474c-b159-af7b43b0cf21 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:40.924404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c5226-9991-474c-b159-af7b43b0cf21 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:40.960486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3b142-1005-4e9d-8718-b0208d5dacbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:40.961876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3b142-1005-4e9d-8718-b0208d5dacbc None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:40.962191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3b142-1005-4e9d-8718-b0208d5dacbc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:40.962464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3b142-1005-4e9d-8718-b0208d5dacbc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:40.963129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3b142-1005-4e9d-8718-b0208d5dacbc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:40.964508 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3b142-1005-4e9d-8718-b0208d5dacbc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-91f3b142-1005-4e9d-8718-b0208d5dacbc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:40.976751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:40.977757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:40.978821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 387/769] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 12 18:46:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:40.984057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62439f17-f0f4-471c-8489-fa5baa030283 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:41.083860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62439f17-f0f4-471c-8489-fa5baa030283 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:41.093190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4039-9898-4419-9ff2-e26c311f62fc None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.093848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4039-9898-4419-9ff2-e26c311f62fc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.094358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4039-9898-4419-9ff2-e26c311f62fc None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.096192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 388/770] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:41.101411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61c78f-b5b9-4266-87be-0c157e49751e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.102002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61c78f-b5b9-4266-87be-0c157e49751e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.102507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61c78f-b5b9-4266-87be-0c157e49751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.126578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ef43-4428-4587-93f8-33909ccc471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:41.127259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ef43-4428-4587-93f8-33909ccc471f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.127543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ef43-4428-4587-93f8-33909ccc471f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.127821 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ef43-4428-4587-93f8-33909ccc471f None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.128542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67ef43-4428-4587-93f8-33909ccc471f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:41.128852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67ef43-4428-4587-93f8-33909ccc471f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:41.137549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67ef43-4428-4587-93f8-33909ccc471f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:41.137708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4d61c78f-b5b9-4266-87be-0c157e49751e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:41.137813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 383/771] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 12 18:46:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:41.138076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4d61c78f-b5b9-4266-87be-0c157e49751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:41.147691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ef43-4428-4587-93f8-33909ccc471f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:41.261505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 389/772] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:46:41.296998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61c78f-b5b9-4266-87be-0c157e49751e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:41.324145 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ef43-4428-4587-93f8-33909ccc471f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:41.387303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b809-6c48-4a63-8221-e8af84a281ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:41.387979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b809-6c48-4a63-8221-e8af84a281ab None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.388263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b809-6c48-4a63-8221-e8af84a281ab None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.388536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b809-6c48-4a63-8221-e8af84a281ab None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.393561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731b809-6c48-4a63-8221-e8af84a281ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:41.393561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731b809-6c48-4a63-8221-e8af84a281ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:41.393561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731b809-6c48-4a63-8221-e8af84a281ab None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:41.397939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 384/773] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 12 18:46:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:41.407215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b809-6c48-4a63-8221-e8af84a281ab None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:41.516942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b809-6c48-4a63-8221-e8af84a281ab None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:41.540209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61c78f-b5b9-4266-87be-0c157e49751e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:41.556290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c0c82-8039-4530-9783-2d6d9203551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:41.558656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c0c82-8039-4530-9783-2d6d9203551d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.558943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c0c82-8039-4530-9783-2d6d9203551d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.559222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c0c82-8039-4530-9783-2d6d9203551d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.560022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c0c82-8039-4530-9783-2d6d9203551d None admin] RBAC: Adding query filter params (interface=public, service_id=7d970c50787e4783bc73833058729934, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:41.560334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c0c82-8039-4530-9783-2d6d9203551d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:41.561729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c0c82-8039-4530-9783-2d6d9203551d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:41.581153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 385/774] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 12 18:46:41 2022] GET /identity/v3/endpoints?service_id=7d970c50787e4783bc73833058729934&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:41.587252 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c0c82-8039-4530-9783-2d6d9203551d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:41.606585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f51b9-1e6b-476e-95a5-f06ff7741b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:41.607398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f51b9-1e6b-476e-95a5-f06ff7741b01 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.607674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f51b9-1e6b-476e-95a5-f06ff7741b01 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.607943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f51b9-1e6b-476e-95a5-f06ff7741b01 None admin] PATH_INFO: `/v3/services/network` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.608605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f51b9-1e6b-476e-95a5-f06ff7741b01 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:41.611777 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f51b9-1e6b-476e-95a5-f06ff7741b01 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-ed9f51b9-1e6b-476e-95a5-f06ff7741b01 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:41.628338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:41.629405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 18:46:41.630895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:41.632473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 390/775] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:41 2022] GET /identity/v3/services/network => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:41.639169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f51b9-1e6b-476e-95a5-f06ff7741b01 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:41.728971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c0c82-8039-4530-9783-2d6d9203551d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:41.768987 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15857ed9-accd-47f5-aa92-dd75b17e1cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:41.769592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15857ed9-accd-47f5-aa92-dd75b17e1cce None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.769875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15857ed9-accd-47f5-aa92-dd75b17e1cce None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.770146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15857ed9-accd-47f5-aa92-dd75b17e1cce None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.770825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15857ed9-accd-47f5-aa92-dd75b17e1cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:41.772195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15857ed9-accd-47f5-aa92-dd75b17e1cce None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:41.786290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 386/776] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 12 18:46:41 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:41.809334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf42a06-3302-444a-a561-5e3402176fba None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.810039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf42a06-3302-444a-a561-5e3402176fba None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.810563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf42a06-3302-444a-a561-5e3402176fba None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.812522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 387/777] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:46:41.818442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810dba-9871-42d4-9e48-1f3a8e1ee045 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.819094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810dba-9871-42d4-9e48-1f3a8e1ee045 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.819585 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810dba-9871-42d4-9e48-1f3a8e1ee045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.838596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ed810dba-9871-42d4-9e48-1f3a8e1ee045 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:41.841789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ed810dba-9871-42d4-9e48-1f3a8e1ee045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:41.868489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f51b9-1e6b-476e-95a5-f06ff7741b01 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:41.921311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdb920-427d-40c3-b581-e4562c9cf840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:41.922278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdb920-427d-40c3-b581-e4562c9cf840 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:41.922561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdb920-427d-40c3-b581-e4562c9cf840 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:41.922833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdb920-427d-40c3-b581-e4562c9cf840 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:41.923652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdb920-427d-40c3-b581-e4562c9cf840 None admin] RBAC: Adding query filter params (name=network) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:41.923960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdb920-427d-40c3-b581-e4562c9cf840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:41.925390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdb920-427d-40c3-b581-e4562c9cf840 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:41.931549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 391/778] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:46:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:41.937389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdb920-427d-40c3-b581-e4562c9cf840 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:41.991454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 388/779] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:46:42.027764 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810dba-9871-42d4-9e48-1f3a8e1ee045 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:42.055699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdb920-427d-40c3-b581-e4562c9cf840 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:42.091953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a40d-29f9-435c-86e3-76c31cc4133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:42.092611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a40d-29f9-435c-86e3-76c31cc4133d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:42.092888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a40d-29f9-435c-86e3-76c31cc4133d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:42.093159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a40d-29f9-435c-86e3-76c31cc4133d None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:42.093906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a40d-29f9-435c-86e3-76c31cc4133d None admin] RBAC: Adding query filter params (type=network) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:42.094264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a40d-29f9-435c-86e3-76c31cc4133d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:42.095678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a40d-29f9-435c-86e3-76c31cc4133d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:42.101158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 392/780] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:46:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:42.107940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a40d-29f9-435c-86e3-76c31cc4133d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:42.140025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810dba-9871-42d4-9e48-1f3a8e1ee045 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:42.214127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3a3f4-31cc-4507-98dc-3003d7452305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:42.215173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a3f4-31cc-4507-98dc-3003d7452305 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:42.215606 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a3f4-31cc-4507-98dc-3003d7452305 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:42.216028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a3f4-31cc-4507-98dc-3003d7452305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:42.240007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3a3f4-31cc-4507-98dc-3003d7452305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-44d3a3f4-31cc-4507-98dc-3003d7452305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:42.256712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:42.257943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:42.259538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 389/781] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:42.264077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3a3f4-31cc-4507-98dc-3003d7452305 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:42.283007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a40d-29f9-435c-86e3-76c31cc4133d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:42.318129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c1c5f-fd75-4f6e-9039-44f6f6b0673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:42.319108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c1c5f-fd75-4f6e-9039-44f6f6b0673d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:42.319542 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c1c5f-fd75-4f6e-9039-44f6f6b0673d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:42.319969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c1c5f-fd75-4f6e-9039-44f6f6b0673d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:42.321443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c1c5f-fd75-4f6e-9039-44f6f6b0673d None admin] RBAC: Adding query filter params (interface=public, service_id=487bbe8e93934e1a8b95d74427ae9f8c, region_id=RegionOne) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:42.321924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c1c5f-fd75-4f6e-9039-44f6f6b0673d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:42.323444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c1c5f-fd75-4f6e-9039-44f6f6b0673d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:42.331534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 393/782] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 12 18:46:42 2022] GET /identity/v3/endpoints?service_id=487bbe8e93934e1a8b95d74427ae9f8c&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:42.337503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c1c5f-fd75-4f6e-9039-44f6f6b0673d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:42.403094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3a3f4-31cc-4507-98dc-3003d7452305 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:42.437407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c1c5f-fd75-4f6e-9039-44f6f6b0673d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:42.453060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a98c3-9f0c-47b7-a41e-e988700d8079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:42.453747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a98c3-9f0c-47b7-a41e-e988700d8079 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:42.454029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a98c3-9f0c-47b7-a41e-e988700d8079 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:42.454305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a98c3-9f0c-47b7-a41e-e988700d8079 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:42.455054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a98c3-9f0c-47b7-a41e-e988700d8079 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:42.455361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a98c3-9f0c-47b7-a41e-e988700d8079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:42.456718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a98c3-9f0c-47b7-a41e-e988700d8079 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:42.473553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed213615-733a-4be3-b6f4-f08b6d3b9bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:42.474055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 390/783] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:42.474624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed213615-733a-4be3-b6f4-f08b6d3b9bbe None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:42.475211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed213615-733a-4be3-b6f4-f08b6d3b9bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:42.475640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed213615-733a-4be3-b6f4-f08b6d3b9bbe None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:42.476538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed213615-733a-4be3-b6f4-f08b6d3b9bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:42.478189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed213615-733a-4be3-b6f4-f08b6d3b9bbe None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:42.479734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a98c3-9f0c-47b7-a41e-e988700d8079 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:42.484624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 394/784] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 12 18:46:42 2022] GET /identity/v3/services => generated 772 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:42.645513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a98c3-9f0c-47b7-a41e-e988700d8079 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:42.694145 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc034f7-704d-439e-be7e-a19d2b89a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:42.695392 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc034f7-704d-439e-be7e-a19d2b89a634 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:42.696444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc034f7-704d-439e-be7e-a19d2b89a634 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:42.696932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc034f7-704d-439e-be7e-a19d2b89a634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:42.708697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc034f7-704d-439e-be7e-a19d2b89a634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:42.710596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc034f7-704d-439e-be7e-a19d2b89a634 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-6bc034f7-704d-439e-be7e-a19d2b89a634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:42.728189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:42.729130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:42.730077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:42.730077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:42.730077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:42.730077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:42.733184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 391/785] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:42.738425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed213615-733a-4be3-b6f4-f08b6d3b9bbe None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:42.843313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed213615-733a-4be3-b6f4-f08b6d3b9bbe None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:42.884711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574bc88-d30a-4d93-8d9b-81c0ea40cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:42.885813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574bc88-d30a-4d93-8d9b-81c0ea40cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:42.886330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574bc88-d30a-4d93-8d9b-81c0ea40cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:42.886846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574bc88-d30a-4d93-8d9b-81c0ea40cfc3 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:42.887801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574bc88-d30a-4d93-8d9b-81c0ea40cfc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:42.888320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574bc88-d30a-4d93-8d9b-81c0ea40cfc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:42.889977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574bc88-d30a-4d93-8d9b-81c0ea40cfc3 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:42.906907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 395/786] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:42.912327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc034f7-704d-439e-be7e-a19d2b89a634 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:43.025395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc034f7-704d-439e-be7e-a19d2b89a634 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:43.074061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac047d-1b53-4041-acbe-0da7af9f4e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:43.075217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac047d-1b53-4041-acbe-0da7af9f4e0c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.075718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac047d-1b53-4041-acbe-0da7af9f4e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.076230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac047d-1b53-4041-acbe-0da7af9f4e0c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.084086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac047d-1b53-4041-acbe-0da7af9f4e0c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:43.085790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac047d-1b53-4041-acbe-0da7af9f4e0c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-25ac047d-1b53-4041-acbe-0da7af9f4e0c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:43.100057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:43.101032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:43.102658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:43.106298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 392/787] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:43.114805 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574bc88-d30a-4d93-8d9b-81c0ea40cfc3 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:43.241451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574bc88-d30a-4d93-8d9b-81c0ea40cfc3 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:43.276944 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9e678-9e2b-4541-a314-23e3ccf6fc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:43.278070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e678-9e2b-4541-a314-23e3ccf6fc1b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.278572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e678-9e2b-4541-a314-23e3ccf6fc1b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.279061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e678-9e2b-4541-a314-23e3ccf6fc1b None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.280138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9e678-9e2b-4541-a314-23e3ccf6fc1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:43.280676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9e678-9e2b-4541-a314-23e3ccf6fc1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:43.282437 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9e678-9e2b-4541-a314-23e3ccf6fc1b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:43.304382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 396/788] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 12 18:46:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:43.314706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac047d-1b53-4041-acbe-0da7af9f4e0c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:43.385106 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7904a62-c008-45f0-9e44-2b875cfca6f3 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.385442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7904a62-c008-45f0-9e44-2b875cfca6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.385687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7904a62-c008-45f0-9e44-2b875cfca6f3 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.387041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 397/789] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:43.393557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7318a-99dc-457e-bfea-3a117253e252 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.395428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7318a-99dc-457e-bfea-3a117253e252 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.395428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7318a-99dc-457e-bfea-3a117253e252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.430529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f6f7318a-99dc-457e-bfea-3a117253e252 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:43.431701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f6f7318a-99dc-457e-bfea-3a117253e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:43.448371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac047d-1b53-4041-acbe-0da7af9f4e0c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:43.486879 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c53a0-79a0-4c68-bcc8-9ee904de34e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:43.488014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c53a0-79a0-4c68-bcc8-9ee904de34e1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.488451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c53a0-79a0-4c68-bcc8-9ee904de34e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.488733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c53a0-79a0-4c68-bcc8-9ee904de34e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.500779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c53a0-79a0-4c68-bcc8-9ee904de34e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:43.502289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c53a0-79a0-4c68-bcc8-9ee904de34e1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d29c53a0-79a0-4c68-bcc8-9ee904de34e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:43.521874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:43.522834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:43.524265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:43.524265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:43.524265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:43.524265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:43.524631 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 393/790] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:43.525998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e7564-1510-4c24-87f0-4db24817988f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.529119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e7564-1510-4c24-87f0-4db24817988f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.529119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e7564-1510-4c24-87f0-4db24817988f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.529119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 394/791] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:43.530105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e7564-1510-4c24-87f0-4db24817988f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:43.555633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 398/792] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:43.561918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d33421-6da6-4542-9b8b-179e821994b0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.563248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d33421-6da6-4542-9b8b-179e821994b0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.563535 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d33421-6da6-4542-9b8b-179e821994b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.585238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-35d33421-6da6-4542-9b8b-179e821994b0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:43.587783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-35d33421-6da6-4542-9b8b-179e821994b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:43.657703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e7564-1510-4c24-87f0-4db24817988f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:43.675886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 399/793] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:43.676997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d33421-6da6-4542-9b8b-179e821994b0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:43.715270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100b9ad-c562-4059-9456-b6c4d5254353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:43.715943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100b9ad-c562-4059-9456-b6c4d5254353 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.716226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100b9ad-c562-4059-9456-b6c4d5254353 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.716507 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100b9ad-c562-4059-9456-b6c4d5254353 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.717246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100b9ad-c562-4059-9456-b6c4d5254353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:43.717590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100b9ad-c562-4059-9456-b6c4d5254353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:43.718967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100b9ad-c562-4059-9456-b6c4d5254353 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:43.731241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 395/794] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:43.732084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100b9ad-c562-4059-9456-b6c4d5254353 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:43.798754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d33421-6da6-4542-9b8b-179e821994b0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:43.832354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48dee5-b2a6-493c-bf6d-4a8a4f5ba7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:43.833194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48dee5-b2a6-493c-bf6d-4a8a4f5ba7d7 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.833482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48dee5-b2a6-493c-bf6d-4a8a4f5ba7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.833808 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48dee5-b2a6-493c-bf6d-4a8a4f5ba7d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.840292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100b9ad-c562-4059-9456-b6c4d5254353 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:43.844563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48dee5-b2a6-493c-bf6d-4a8a4f5ba7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-ef48dee5-b2a6-493c-bf6d-4a8a4f5ba7d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:43.852665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:43.854951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:43.857012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:43.865615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 400/795] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:43.865615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48dee5-b2a6-493c-bf6d-4a8a4f5ba7d7 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:43.881730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d494b4e-f0b3-4094-8261-bc2387635475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:43.881730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d494b4e-f0b3-4094-8261-bc2387635475 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:43.881730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d494b4e-f0b3-4094-8261-bc2387635475 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:43.882245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d494b4e-f0b3-4094-8261-bc2387635475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:43.896988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d494b4e-f0b3-4094-8261-bc2387635475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5d494b4e-f0b3-4094-8261-bc2387635475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:43.907051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:43.908466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:43.909367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 396/796] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:43.910118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d494b4e-f0b3-4094-8261-bc2387635475 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:43.972068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48dee5-b2a6-493c-bf6d-4a8a4f5ba7d7 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.013364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94a112-bc3f-4c56-a274-07d5ae63a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.014184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a112-bc3f-4c56-a274-07d5ae63a061 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.014465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a112-bc3f-4c56-a274-07d5ae63a061 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.014738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a112-bc3f-4c56-a274-07d5ae63a061 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.023362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94a112-bc3f-4c56-a274-07d5ae63a061 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.024833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94a112-bc3f-4c56-a274-07d5ae63a061 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.037683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d494b4e-f0b3-4094-8261-bc2387635475 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-db94a112-bc3f-4c56-a274-07d5ae63a061 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:44.040633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:44.041602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:44.042633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:44.042633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:44.042633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:44.042633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:44.042633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:44.042633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:44.042633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:44.042633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:44.042633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 401/797] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:44.043127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94a112-bc3f-4c56-a274-07d5ae63a061 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.085018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd33d8-5034-47b8-a73d-9e0496c028e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.085660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd33d8-5034-47b8-a73d-9e0496c028e1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.085942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd33d8-5034-47b8-a73d-9e0496c028e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.086300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd33d8-5034-47b8-a73d-9e0496c028e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.087055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd33d8-5034-47b8-a73d-9e0496c028e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:44.087417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd33d8-5034-47b8-a73d-9e0496c028e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.089314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd33d8-5034-47b8-a73d-9e0496c028e1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.099495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 397/798] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:44.100301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd33d8-5034-47b8-a73d-9e0496c028e1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.152929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94a112-bc3f-4c56-a274-07d5ae63a061 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.187663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458bc9-f68f-4657-8c31-bebbb6f9dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.188379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458bc9-f68f-4657-8c31-bebbb6f9dc99 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.188662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458bc9-f68f-4657-8c31-bebbb6f9dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.188933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458bc9-f68f-4657-8c31-bebbb6f9dc99 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.189714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7458bc9-f68f-4657-8c31-bebbb6f9dc99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:44.190019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7458bc9-f68f-4657-8c31-bebbb6f9dc99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.191419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7458bc9-f68f-4657-8c31-bebbb6f9dc99 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.200047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd33d8-5034-47b8-a73d-9e0496c028e1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.200996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 402/799] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:44.201984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458bc9-f68f-4657-8c31-bebbb6f9dc99 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.237882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51734d-b0cc-4d94-abf1-16c77fceda2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.238546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51734d-b0cc-4d94-abf1-16c77fceda2c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.238825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51734d-b0cc-4d94-abf1-16c77fceda2c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.239099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51734d-b0cc-4d94-abf1-16c77fceda2c None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.239890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51734d-b0cc-4d94-abf1-16c77fceda2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:44.240194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51734d-b0cc-4d94-abf1-16c77fceda2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.241626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51734d-b0cc-4d94-abf1-16c77fceda2c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.255240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 398/800] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:44.256136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51734d-b0cc-4d94-abf1-16c77fceda2c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.307680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458bc9-f68f-4657-8c31-bebbb6f9dc99 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.342832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb256ab-381a-492d-a672-3fc37865ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.343593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb256ab-381a-492d-a672-3fc37865ae50 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.343875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb256ab-381a-492d-a672-3fc37865ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.344146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb256ab-381a-492d-a672-3fc37865ae50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.355426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb256ab-381a-492d-a672-3fc37865ae50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.356664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51734d-b0cc-4d94-abf1-16c77fceda2c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.356869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb256ab-381a-492d-a672-3fc37865ae50 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-7eb256ab-381a-492d-a672-3fc37865ae50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:44.374339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:44.375337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:44.376252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:44.376252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:44.376252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:44.376252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:44.376252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 403/801] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:44.377120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb256ab-381a-492d-a672-3fc37865ae50 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.391337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df008-96b4-4af6-9c21-80184ee0e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.392122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df008-96b4-4af6-9c21-80184ee0e532 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.392547 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df008-96b4-4af6-9c21-80184ee0e532 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.392819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df008-96b4-4af6-9c21-80184ee0e532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.406510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df008-96b4-4af6-9c21-80184ee0e532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.408283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df008-96b4-4af6-9c21-80184ee0e532 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-496df008-96b4-4af6-9c21-80184ee0e532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:44.426131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:44.428560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:44.431522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:44.431522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:44.431522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:44.431522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:44.431522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 399/802] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:44.431522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df008-96b4-4af6-9c21-80184ee0e532 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.480333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb256ab-381a-492d-a672-3fc37865ae50 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.512762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263c10f-1c1a-4b7c-929d-9e73fe70f34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.513804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c10f-1c1a-4b7c-929d-9e73fe70f34f None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.514084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c10f-1c1a-4b7c-929d-9e73fe70f34f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.514354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c10f-1c1a-4b7c-929d-9e73fe70f34f None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/84eb7224717643288cc61f8e6f901543/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.516285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263c10f-1c1a-4b7c-929d-9e73fe70f34f None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=84eb7224717643288cc61f8e6f901543, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.517749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263c10f-1c1a-4b7c-929d-9e73fe70f34f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.525803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df008-96b4-4af6-9c21-80184ee0e532 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.537588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 404/803] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:46:44 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/84eb7224717643288cc61f8e6f901543/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:44.537588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ff1a-feab-4159-8edb-b8d6b25c8c3b None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.537588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ff1a-feab-4159-8edb-b8d6b25c8c3b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.537588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ff1a-feab-4159-8edb-b8d6b25c8c3b None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.537588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 405/804] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:44.537588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5ff1a-feab-4159-8edb-b8d6b25c8c3b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.570126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22060148-fd13-4167-ba9b-f8ee72a5a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.571458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22060148-fd13-4167-ba9b-f8ee72a5a142 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.571738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22060148-fd13-4167-ba9b-f8ee72a5a142 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.572012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22060148-fd13-4167-ba9b-f8ee72a5a142 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.572741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22060148-fd13-4167-ba9b-f8ee72a5a142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:44.573047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22060148-fd13-4167-ba9b-f8ee72a5a142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.574452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22060148-fd13-4167-ba9b-f8ee72a5a142 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.588367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 400/805] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:44.589825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874327f0-7f3d-433b-b1ef-5879433c9fe1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.590170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874327f0-7f3d-433b-b1ef-5879433c9fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.590447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874327f0-7f3d-433b-b1ef-5879433c9fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.608679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-874327f0-7f3d-433b-b1ef-5879433c9fe1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:44.611414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-874327f0-7f3d-433b-b1ef-5879433c9fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:44.686318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5ff1a-feab-4159-8edb-b8d6b25c8c3b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.697937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 401/806] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:44.698929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874327f0-7f3d-433b-b1ef-5879433c9fe1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.725295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e88c92-25bc-44a4-b41c-32e4076a7f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.726059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88c92-25bc-44a4-b41c-32e4076a7f9a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.726340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88c92-25bc-44a4-b41c-32e4076a7f9a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.726646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88c92-25bc-44a4-b41c-32e4076a7f9a None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.727383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e88c92-25bc-44a4-b41c-32e4076a7f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:44.727688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e88c92-25bc-44a4-b41c-32e4076a7f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.730543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e88c92-25bc-44a4-b41c-32e4076a7f9a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.743179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 406/807] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:44.744168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e88c92-25bc-44a4-b41c-32e4076a7f9a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.816191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874327f0-7f3d-433b-b1ef-5879433c9fe1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.844113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e88c92-25bc-44a4-b41c-32e4076a7f9a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:44.851172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7229922-a57e-461c-831a-d9ca35b64f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.852018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7229922-a57e-461c-831a-d9ca35b64f8f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.852299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7229922-a57e-461c-831a-d9ca35b64f8f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.852572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7229922-a57e-461c-831a-d9ca35b64f8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.859989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7229922-a57e-461c-831a-d9ca35b64f8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.861381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7229922-a57e-461c-831a-d9ca35b64f8f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d7229922-a57e-461c-831a-d9ca35b64f8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:44.879533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:44.880511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:46:44.882464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:44.884358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d61e-6302-4a46-a4b8-68f25e9acc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:44.884358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d61e-6302-4a46-a4b8-68f25e9acc3a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:44.884358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d61e-6302-4a46-a4b8-68f25e9acc3a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:44.884584 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 402/808] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:44.884653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d61e-6302-4a46-a4b8-68f25e9acc3a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:44.884729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7229922-a57e-461c-831a-d9ca35b64f8f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:44.884799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d61e-6302-4a46-a4b8-68f25e9acc3a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:44.884799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d61e-6302-4a46-a4b8-68f25e9acc3a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-d3d5d61e-6302-4a46-a4b8-68f25e9acc3a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:44.900646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:44.901687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 18:46:44.902541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:44.904892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 407/809] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:44.904892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d61e-6302-4a46-a4b8-68f25e9acc3a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.007160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7229922-a57e-461c-831a-d9ca35b64f8f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.019194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d61e-6302-4a46-a4b8-68f25e9acc3a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.042009 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df66b2-0d9b-4223-8ab0-bc95e8eb6c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.042802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df66b2-0d9b-4223-8ab0-bc95e8eb6c96 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.043087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df66b2-0d9b-4223-8ab0-bc95e8eb6c96 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.043425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df66b2-0d9b-4223-8ab0-bc95e8eb6c96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.053245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968d7d5-e602-42eb-bed7-1869bea58505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.053569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df66b2-0d9b-4223-8ab0-bc95e8eb6c96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.053967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968d7d5-e602-42eb-bed7-1869bea58505 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.054252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968d7d5-e602-42eb-bed7-1869bea58505 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.054529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968d7d5-e602-42eb-bed7-1869bea58505 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.055563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df66b2-0d9b-4223-8ab0-bc95e8eb6c96 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.055906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968d7d5-e602-42eb-bed7-1869bea58505 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:45.056213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968d7d5-e602-42eb-bed7-1869bea58505 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.057662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968d7d5-e602-42eb-bed7-1869bea58505 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d5df66b2-0d9b-4223-8ab0-bc95e8eb6c96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:45.071632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:45.073954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 18:46:45.076250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:45.078350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 403/811] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:45.080074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df66b2-0d9b-4223-8ab0-bc95e8eb6c96 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.081567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 408/811] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 12 18:46:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:45.081567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968d7d5-e602-42eb-bed7-1869bea58505 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.179108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df66b2-0d9b-4223-8ab0-bc95e8eb6c96 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.185163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968d7d5-e602-42eb-bed7-1869bea58505 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.212634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751968b8-6845-4175-977d-f21c03c0a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.213300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751968b8-6845-4175-977d-f21c03c0a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.213616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751968b8-6845-4175-977d-f21c03c0a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.213897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751968b8-6845-4175-977d-f21c03c0a9c5 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.214598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751968b8-6845-4175-977d-f21c03c0a9c5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:45.214907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751968b8-6845-4175-977d-f21c03c0a9c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.216282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751968b8-6845-4175-977d-f21c03c0a9c5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.220643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 404/812] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 12 18:46:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:45.221138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3d27-80e0-484e-b7e7-ff08b4011b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.221413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751968b8-6845-4175-977d-f21c03c0a9c5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.222264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3d27-80e0-484e-b7e7-ff08b4011b22 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.222623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3d27-80e0-484e-b7e7-ff08b4011b22 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.222964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3d27-80e0-484e-b7e7-ff08b4011b22 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.223860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3d27-80e0-484e-b7e7-ff08b4011b22 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:45.224230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3d27-80e0-484e-b7e7-ff08b4011b22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.225747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3d27-80e0-484e-b7e7-ff08b4011b22 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.245278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 409/813] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 12 18:46:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:45.246624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd0280-c277-4694-93b4-40069f38a96c None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.246911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd0280-c277-4694-93b4-40069f38a96c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.247186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd0280-c277-4694-93b4-40069f38a96c None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.248556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 410/814] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:45.249081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd0280-c277-4694-93b4-40069f38a96c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.333824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751968b8-6845-4175-977d-f21c03c0a9c5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.353086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd0280-c277-4694-93b4-40069f38a96c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.370562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211c4ba-ab0d-4897-99e3-3561083a8859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.371356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211c4ba-ab0d-4897-99e3-3561083a8859 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.371639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211c4ba-ab0d-4897-99e3-3561083a8859 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.371914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211c4ba-ab0d-4897-99e3-3561083a8859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.382463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211c4ba-ab0d-4897-99e3-3561083a8859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.383869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211c4ba-ab0d-4897-99e3-3561083a8859 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.385829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5cda-1c01-479d-833c-cb13cf11818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.386543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5cda-1c01-479d-833c-cb13cf11818a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.386872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5cda-1c01-479d-833c-cb13cf11818a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.387197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5cda-1c01-479d-833c-cb13cf11818a None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.387951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d5cda-1c01-479d-833c-cb13cf11818a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:45.388254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d5cda-1c01-479d-833c-cb13cf11818a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.389689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d5cda-1c01-479d-833c-cb13cf11818a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.399137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 411/815] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 12 18:46:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:45.399137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5cda-1c01-479d-833c-cb13cf11818a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5211c4ba-ab0d-4897-99e3-3561083a8859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:45.400636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:45.401564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:45.402787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:45.402787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:45.402787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:45.402787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:45.402787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 405/816] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:45.403411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8fd24-e9c4-4f4b-82ed-7b32d87317e1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.403699 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8fd24-e9c4-4f4b-82ed-7b32d87317e1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.403971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8fd24-e9c4-4f4b-82ed-7b32d87317e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.420701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d1b8fd24-e9c4-4f4b-82ed-7b32d87317e1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:45.422183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d1b8fd24-e9c4-4f4b-82ed-7b32d87317e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:45.492128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 406/817] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:45.493805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8fd24-e9c4-4f4b-82ed-7b32d87317e1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.499496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5cda-1c01-479d-833c-cb13cf11818a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.535957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960ab90-f293-46f6-8e10-74c6a0e68167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.536958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960ab90-f293-46f6-8e10-74c6a0e68167 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.537325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960ab90-f293-46f6-8e10-74c6a0e68167 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.537634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960ab90-f293-46f6-8e10-74c6a0e68167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.590542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8fd24-e9c4-4f4b-82ed-7b32d87317e1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.611484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960ab90-f293-46f6-8e10-74c6a0e68167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.612933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960ab90-f293-46f6-8e10-74c6a0e68167 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.625815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff201dfc-4668-466d-a406-8dbfe88a1540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.626471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff201dfc-4668-466d-a406-8dbfe88a1540 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.626760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff201dfc-4668-466d-a406-8dbfe88a1540 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.627044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff201dfc-4668-466d-a406-8dbfe88a1540 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.627781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff201dfc-4668-466d-a406-8dbfe88a1540 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.629136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff201dfc-4668-466d-a406-8dbfe88a1540 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.665633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 407/818] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 12 18:46:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:45.665633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff201dfc-4668-466d-a406-8dbfe88a1540 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.726421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 412/819] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:46:45.731371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960ab90-f293-46f6-8e10-74c6a0e68167 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.817091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff201dfc-4668-466d-a406-8dbfe88a1540 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.842020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960ab90-f293-46f6-8e10-74c6a0e68167 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:45.860932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f4ce4-f9de-400b-a087-f1c4eb9cb444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.861637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f4ce4-f9de-400b-a087-f1c4eb9cb444 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.861929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f4ce4-f9de-400b-a087-f1c4eb9cb444 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.862210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f4ce4-f9de-400b-a087-f1c4eb9cb444 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.862943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f4ce4-f9de-400b-a087-f1c4eb9cb444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:45.863255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f4ce4-f9de-400b-a087-f1c4eb9cb444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.864635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f4ce4-f9de-400b-a087-f1c4eb9cb444 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.876380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 408/820] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:45.877040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f4ce4-f9de-400b-a087-f1c4eb9cb444 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:45.882414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257cb1-7aaf-4a3e-922a-bc01953e5f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:45.883262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257cb1-7aaf-4a3e-922a-bc01953e5f7b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:45.883543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257cb1-7aaf-4a3e-922a-bc01953e5f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:45.883815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257cb1-7aaf-4a3e-922a-bc01953e5f7b None admin] PATH_INFO: `/v3/services/network` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:45.884538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea257cb1-7aaf-4a3e-922a-bc01953e5f7b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:45.886142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea257cb1-7aaf-4a3e-922a-bc01953e5f7b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-ea257cb1-7aaf-4a3e-922a-bc01953e5f7b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:45.900975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:45.902682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:45.903872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 413/821] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:45 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:45.905102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257cb1-7aaf-4a3e-922a-bc01953e5f7b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.010509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f4ce4-f9de-400b-a087-f1c4eb9cb444 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.037646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257cb1-7aaf-4a3e-922a-bc01953e5f7b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.046753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaf06f-ddd9-469d-bac7-f2b9de28923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.048155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf06f-ddd9-469d-bac7-f2b9de28923a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.048699 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf06f-ddd9-469d-bac7-f2b9de28923a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.049200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf06f-ddd9-469d-bac7-f2b9de28923a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.060355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaf06f-ddd9-469d-bac7-f2b9de28923a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.062112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaf06f-ddd9-469d-bac7-f2b9de28923a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.075883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46971703-25a6-4e94-88d9-a385f36967a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.076668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971703-25a6-4e94-88d9-a385f36967a4 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.076943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971703-25a6-4e94-88d9-a385f36967a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.077220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971703-25a6-4e94-88d9-a385f36967a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-0feaf06f-ddd9-469d-bac7-f2b9de28923a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:46.081116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:46.082188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:46.083113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:46.083113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:46.083113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:46.083113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:46.084177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46971703-25a6-4e94-88d9-a385f36967a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.085450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 409/822] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:46.085680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46971703-25a6-4e94-88d9-a385f36967a4 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.087244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaf06f-ddd9-469d-bac7-f2b9de28923a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-46971703-25a6-4e94-88d9-a385f36967a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:46.109288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:46.110335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:46.111240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:46.111240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:46.111240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:46.111240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:46.111240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:46.111240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:46.111240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:46.111240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:46.111240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 414/823] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:46.111747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46971703-25a6-4e94-88d9-a385f36967a4 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.216913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46971703-25a6-4e94-88d9-a385f36967a4 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.218424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaf06f-ddd9-469d-bac7-f2b9de28923a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.251528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3211a4-5b2f-40c0-a238-4b8c2711525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.252574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3211a4-5b2f-40c0-a238-4b8c2711525c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.253063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3211a4-5b2f-40c0-a238-4b8c2711525c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.253646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3211a4-5b2f-40c0-a238-4b8c2711525c None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.254621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3211a4-5b2f-40c0-a238-4b8c2711525c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:46.255129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3211a4-5b2f-40c0-a238-4b8c2711525c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.256775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3211a4-5b2f-40c0-a238-4b8c2711525c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.257515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244e405-5ebe-4517-b147-112680f17f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.258808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244e405-5ebe-4517-b147-112680f17f04 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.259183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244e405-5ebe-4517-b147-112680f17f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.259521 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244e405-5ebe-4517-b147-112680f17f04 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.260504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244e405-5ebe-4517-b147-112680f17f04 None admin] RBAC: Adding query filter params (name=network) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:46.260931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244e405-5ebe-4517-b147-112680f17f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.262546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244e405-5ebe-4517-b147-112680f17f04 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.272344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 410/824] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:46:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:46.273591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244e405-5ebe-4517-b147-112680f17f04 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.277570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 415/825] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:46.278328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3211a4-5b2f-40c0-a238-4b8c2711525c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.381481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244e405-5ebe-4517-b147-112680f17f04 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.411846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3211a4-5b2f-40c0-a238-4b8c2711525c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.415781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928dd17-6745-484f-8c6e-75d1b9976622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.416491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928dd17-6745-484f-8c6e-75d1b9976622 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.416780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928dd17-6745-484f-8c6e-75d1b9976622 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.417059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928dd17-6745-484f-8c6e-75d1b9976622 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.417891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928dd17-6745-484f-8c6e-75d1b9976622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:46.418206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928dd17-6745-484f-8c6e-75d1b9976622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.419636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928dd17-6745-484f-8c6e-75d1b9976622 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.433402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 411/826] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:46.434334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928dd17-6745-484f-8c6e-75d1b9976622 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.455209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a818f6-c558-473a-8665-eff30f1d48c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.456372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a818f6-c558-473a-8665-eff30f1d48c8 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.457316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a818f6-c558-473a-8665-eff30f1d48c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.457974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a818f6-c558-473a-8665-eff30f1d48c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.467700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a818f6-c558-473a-8665-eff30f1d48c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.469551 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a818f6-c558-473a-8665-eff30f1d48c8 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-09a818f6-c558-473a-8665-eff30f1d48c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:46.487875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:46.488994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:46.490222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:46.490222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:46.490222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:46.490222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:46.490222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:46.490222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:46.490222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:46.490222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:46.493571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 416/827] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:46.494572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a818f6-c558-473a-8665-eff30f1d48c8 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.552611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928dd17-6745-484f-8c6e-75d1b9976622 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.595990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c3578-9e81-4a29-ab4d-0b471f3770ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.597596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c3578-9e81-4a29-ab4d-0b471f3770ad None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.598147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c3578-9e81-4a29-ab4d-0b471f3770ad None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.598602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c3578-9e81-4a29-ab4d-0b471f3770ad None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.599654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c3578-9e81-4a29-ab4d-0b471f3770ad None admin] RBAC: Adding query filter params (type=network) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:46.600202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c3578-9e81-4a29-ab4d-0b471f3770ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.602619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c3578-9e81-4a29-ab4d-0b471f3770ad None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.609019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 412/828] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:46:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:46.610125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c3578-9e81-4a29-ab4d-0b471f3770ad None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.626390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a818f6-c558-473a-8665-eff30f1d48c8 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.667882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babc458-b28f-4558-8e9a-e71fdbb3ad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.669025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babc458-b28f-4558-8e9a-e71fdbb3ad11 None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.669379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babc458-b28f-4558-8e9a-e71fdbb3ad11 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.669763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babc458-b28f-4558-8e9a-e71fdbb3ad11 None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/6cf36b056ece466ea23001b8d33c16a2/roles/4803c7e1a903431faba9ebef03061c0d` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.689564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babc458-b28f-4558-8e9a-e71fdbb3ad11 None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=6cf36b056ece466ea23001b8d33c16a2, role_id=4803c7e1a903431faba9ebef03061c0d)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.691486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babc458-b28f-4558-8e9a-e71fdbb3ad11 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.710397 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 417/829] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:46:46 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/6cf36b056ece466ea23001b8d33c16a2/roles/4803c7e1a903431faba9ebef03061c0d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:46:46.711815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babc458-b28f-4558-8e9a-e71fdbb3ad11 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.735963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c3578-9e81-4a29-ab4d-0b471f3770ad None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.776162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616aacc-aee5-48de-823b-1556cd0ff3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.777176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616aacc-aee5-48de-823b-1556cd0ff3ef None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.777704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616aacc-aee5-48de-823b-1556cd0ff3ef None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.778241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616aacc-aee5-48de-823b-1556cd0ff3ef None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.779437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616aacc-aee5-48de-823b-1556cd0ff3ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:46.779979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616aacc-aee5-48de-823b-1556cd0ff3ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616aacc-aee5-48de-823b-1556cd0ff3ef None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.796312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 413/830] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:46.809634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616aacc-aee5-48de-823b-1556cd0ff3ef None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:46.905549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babc458-b28f-4558-8e9a-e71fdbb3ad11 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.945550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ef64f-de71-4920-9700-2f790d4176a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:46.945550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ef64f-de71-4920-9700-2f790d4176a9 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.945550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ef64f-de71-4920-9700-2f790d4176a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.945550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ef64f-de71-4920-9700-2f790d4176a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.945967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ef64f-de71-4920-9700-2f790d4176a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:46.949556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ef64f-de71-4920-9700-2f790d4176a9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:46.953549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616aacc-aee5-48de-823b-1556cd0ff3ef None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:46.976405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 418/831] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 12 18:46:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:46.976405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd50c71-ad5d-48fd-a2e9-1b54089d69ba None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.976405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd50c71-ad5d-48fd-a2e9-1b54089d69ba None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.976405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd50c71-ad5d-48fd-a2e9-1b54089d69ba None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:46.982338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 419/832] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:46.988138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a56c1-d314-4624-821d-22afa1fce4fc None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:46.988464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a56c1-d314-4624-821d-22afa1fce4fc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:46.988698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a56c1-d314-4624-821d-22afa1fce4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:47.026462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fabc9-a8b9-4ee7-ac13-cd2bb74528c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:47.030337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fabc9-a8b9-4ee7-ac13-cd2bb74528c5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:47.030337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fabc9-a8b9-4ee7-ac13-cd2bb74528c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:47.030337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fabc9-a8b9-4ee7-ac13-cd2bb74528c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:47.030337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fabc9-a8b9-4ee7-ac13-cd2bb74528c5 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=e2e41b41f355446c8462fafcd91c183f) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:47.030337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fabc9-a8b9-4ee7-ac13-cd2bb74528c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:47.030770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-af2a56c1-d314-4624-821d-22afa1fce4fc None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:47.031723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fabc9-a8b9-4ee7-ac13-cd2bb74528c5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:47.031922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-af2a56c1-d314-4624-821d-22afa1fce4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:47.040181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 414/833] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:46 2022] GET /identity/v3/role_assignments?user.id=e2e41b41f355446c8462fafcd91c183f&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=d03e020b3fb34446bbf5893b28904483 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:47.154006 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 420/834] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:46:47.178935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fabc9-a8b9-4ee7-ac13-cd2bb74528c5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:47.368985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fabc9-a8b9-4ee7-ac13-cd2bb74528c5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:47.406097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d50e8-44d3-46b2-a0d2-1087aac428fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:47.406823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d50e8-44d3-46b2-a0d2-1087aac428fd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:47.407109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d50e8-44d3-46b2-a0d2-1087aac428fd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:47.407387 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d50e8-44d3-46b2-a0d2-1087aac428fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:47.420697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d50e8-44d3-46b2-a0d2-1087aac428fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-185d50e8-44d3-46b2-a0d2-1087aac428fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:47.428850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:47.429890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:46:47.430754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:47.434933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 415/835] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:47.436310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a56c1-d314-4624-821d-22afa1fce4fc None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:47.546570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a56c1-d314-4624-821d-22afa1fce4fc None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:47.579828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda700-2dc9-4aec-a056-b22692ebb778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:47.580497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda700-2dc9-4aec-a056-b22692ebb778 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:47.580777 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda700-2dc9-4aec-a056-b22692ebb778 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:47.581046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda700-2dc9-4aec-a056-b22692ebb778 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:47.581807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda700-2dc9-4aec-a056-b22692ebb778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:47.582109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda700-2dc9-4aec-a056-b22692ebb778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:47.583465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda700-2dc9-4aec-a056-b22692ebb778 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:47.594067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 421/836] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:47.599707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d50e8-44d3-46b2-a0d2-1087aac428fd None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:47.703388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d50e8-44d3-46b2-a0d2-1087aac428fd None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:47.740565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab888e72-adaa-4151-bde3-32ee46ecd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:47.741750 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab888e72-adaa-4151-bde3-32ee46ecd12c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:47.742271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab888e72-adaa-4151-bde3-32ee46ecd12c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:47.742782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab888e72-adaa-4151-bde3-32ee46ecd12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:47.754436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab888e72-adaa-4151-bde3-32ee46ecd12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:47.756214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab888e72-adaa-4151-bde3-32ee46ecd12c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ab888e72-adaa-4151-bde3-32ee46ecd12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:47.775350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:47.776298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:47.777214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:47.777214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:47.777214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:47.777214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:47.779499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 416/837] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:47.786635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda700-2dc9-4aec-a056-b22692ebb778 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:47.889086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda700-2dc9-4aec-a056-b22692ebb778 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:47.923163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e7e86-0f0e-4d42-97e3-9162e31cfcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:47.923814 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e7e86-0f0e-4d42-97e3-9162e31cfcee None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:47.924090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e7e86-0f0e-4d42-97e3-9162e31cfcee None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:47.924363 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e7e86-0f0e-4d42-97e3-9162e31cfcee None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:47.925066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e7e86-0f0e-4d42-97e3-9162e31cfcee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:47.925367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e7e86-0f0e-4d42-97e3-9162e31cfcee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:47.926754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e7e86-0f0e-4d42-97e3-9162e31cfcee None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:47.940540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 422/838] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:47.946445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab888e72-adaa-4151-bde3-32ee46ecd12c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:48.049180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab888e72-adaa-4151-bde3-32ee46ecd12c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:48.084372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52331c7a-d76b-4afd-95b0-6d002d968435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:48.085518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52331c7a-d76b-4afd-95b0-6d002d968435 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.086118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52331c7a-d76b-4afd-95b0-6d002d968435 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.086602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52331c7a-d76b-4afd-95b0-6d002d968435 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.094293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52331c7a-d76b-4afd-95b0-6d002d968435 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:48.096007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52331c7a-d76b-4afd-95b0-6d002d968435 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-52331c7a-d76b-4afd-95b0-6d002d968435 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:48.111887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:48.112937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 18:46:48.114030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:48.116878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 417/839] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:46:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:48.128731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e7e86-0f0e-4d42-97e3-9162e31cfcee None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:48.230594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e7e86-0f0e-4d42-97e3-9162e31cfcee None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:48.265686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791db7f-5725-4fe4-84d2-1d7843b03833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:48.266352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791db7f-5725-4fe4-84d2-1d7843b03833 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.266629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791db7f-5725-4fe4-84d2-1d7843b03833 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.266899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791db7f-5725-4fe4-84d2-1d7843b03833 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.267730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791db7f-5725-4fe4-84d2-1d7843b03833 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:48.268031 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791db7f-5725-4fe4-84d2-1d7843b03833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:48.271833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791db7f-5725-4fe4-84d2-1d7843b03833 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:48.295523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 423/840] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 12 18:46:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:48.301150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52331c7a-d76b-4afd-95b0-6d002d968435 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:48.312370 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4364384-c3a2-4b15-92e3-1ceb4bc3689c None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.312370 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4364384-c3a2-4b15-92e3-1ceb4bc3689c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.312679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4364384-c3a2-4b15-92e3-1ceb4bc3689c None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.314160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 424/841] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:46:48.318881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec4c4-3aa4-491d-85a4-1b375ad96fc4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.319162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec4c4-3aa4-491d-85a4-1b375ad96fc4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.319438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec4c4-3aa4-491d-85a4-1b375ad96fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.335562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d8cec4c4-3aa4-491d-85a4-1b375ad96fc4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:48.336766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d8cec4c4-3aa4-491d-85a4-1b375ad96fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:48.403795 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52331c7a-d76b-4afd-95b0-6d002d968435 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:48.407890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 425/842] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:46:48.433206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec4c4-3aa4-491d-85a4-1b375ad96fc4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:48.439003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134b7b2-7b65-4e36-97a1-1ca4e9a0e93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:48.439671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134b7b2-7b65-4e36-97a1-1ca4e9a0e93e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.439953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134b7b2-7b65-4e36-97a1-1ca4e9a0e93e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.440227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134b7b2-7b65-4e36-97a1-1ca4e9a0e93e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.507458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134b7b2-7b65-4e36-97a1-1ca4e9a0e93e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:48.508952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134b7b2-7b65-4e36-97a1-1ca4e9a0e93e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:48.535852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec4c4-3aa4-491d-85a4-1b375ad96fc4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:48.572166 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3899ec4-470b-4a8e-8344-7c70294c9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:48.573359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3899ec4-470b-4a8e-8344-7c70294c9106 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.573896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3899ec4-470b-4a8e-8344-7c70294c9106 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.574437 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3899ec4-470b-4a8e-8344-7c70294c9106 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.575308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3899ec4-470b-4a8e-8344-7c70294c9106 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:48.576888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3899ec4-470b-4a8e-8344-7c70294c9106 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-c3899ec4-470b-4a8e-8344-7c70294c9106 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:48.589920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:48.590997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 18:46:48.591874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:48.599763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 426/843] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:48.601003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3899ec4-470b-4a8e-8344-7c70294c9106 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:48.609491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 418/844] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:46:48.615427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134b7b2-7b65-4e36-97a1-1ca4e9a0e93e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:48.718971 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3899ec4-470b-4a8e-8344-7c70294c9106 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:48.741028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134b7b2-7b65-4e36-97a1-1ca4e9a0e93e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:48.760197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246ba81-2f4c-45be-8292-f64ec40caab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:48.761617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246ba81-2f4c-45be-8292-f64ec40caab0 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.762353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246ba81-2f4c-45be-8292-f64ec40caab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.762826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246ba81-2f4c-45be-8292-f64ec40caab0 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.764192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246ba81-2f4c-45be-8292-f64ec40caab0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:48.764984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246ba81-2f4c-45be-8292-f64ec40caab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:48.767032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246ba81-2f4c-45be-8292-f64ec40caab0 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:48.773184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 427/845] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:48.779819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c3a74-535e-4f9f-b803-d36f18006d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:48.781182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c3a74-535e-4f9f-b803-d36f18006d09 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.781544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246ba81-2f4c-45be-8292-f64ec40caab0 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:48.781927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c3a74-535e-4f9f-b803-d36f18006d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.782393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c3a74-535e-4f9f-b803-d36f18006d09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.796237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c3a74-535e-4f9f-b803-d36f18006d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:48.798760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c3a74-535e-4f9f-b803-d36f18006d09 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-568c3a74-535e-4f9f-b803-d36f18006d09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:48.820929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:48.821950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:48.822905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:48.822905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:48.822905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:48.822905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:48.822905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 419/846] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:48.827677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c3a74-535e-4f9f-b803-d36f18006d09 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:48.916728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246ba81-2f4c-45be-8292-f64ec40caab0 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:48.934312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c3a74-535e-4f9f-b803-d36f18006d09 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:48.950606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a388b-d3f7-4e43-8742-5a061fc2de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:48.951273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a388b-d3f7-4e43-8742-5a061fc2de3a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.951607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a388b-d3f7-4e43-8742-5a061fc2de3a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.951885 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a388b-d3f7-4e43-8742-5a061fc2de3a None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.952590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a388b-d3f7-4e43-8742-5a061fc2de3a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:48.952935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a388b-d3f7-4e43-8742-5a061fc2de3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:48.954362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a388b-d3f7-4e43-8742-5a061fc2de3a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:48.959456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 428/847] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:48.978528 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c34ed-36b7-4f24-bbe4-7b0c3f5803e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:48.979526 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c34ed-36b7-4f24-bbe4-7b0c3f5803e3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:48.980068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c34ed-36b7-4f24-bbe4-7b0c3f5803e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:48.980672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c34ed-36b7-4f24-bbe4-7b0c3f5803e3 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:48.981697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c34ed-36b7-4f24-bbe4-7b0c3f5803e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:48.982160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c34ed-36b7-4f24-bbe4-7b0c3f5803e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:48.983761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c34ed-36b7-4f24-bbe4-7b0c3f5803e3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:48.997783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 420/848] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:49.004583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a388b-d3f7-4e43-8742-5a061fc2de3a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:49.119653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a388b-d3f7-4e43-8742-5a061fc2de3a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:49.159076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e7518-8386-4779-a117-b5ea94023ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:49.159941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e7518-8386-4779-a117-b5ea94023ec1 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.160225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e7518-8386-4779-a117-b5ea94023ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.160497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e7518-8386-4779-a117-b5ea94023ec1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.168784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e7518-8386-4779-a117-b5ea94023ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:49.170069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e7518-8386-4779-a117-b5ea94023ec1 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-294e7518-8386-4779-a117-b5ea94023ec1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:49.187634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:49.188602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:49.189507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:49.189507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:49.189507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:49.189507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:49.189507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:49.189507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:49.189507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:49.189507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:49.191782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 429/849] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:49.195785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c34ed-36b7-4f24-bbe4-7b0c3f5803e3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:49.306696 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17979ade-a69a-462a-8a3d-91fc671975df None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.307052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17979ade-a69a-462a-8a3d-91fc671975df None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.307244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17979ade-a69a-462a-8a3d-91fc671975df None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.307474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c34ed-36b7-4f24-bbe4-7b0c3f5803e3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:49.309009 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 430/850] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:46:49.314479 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0bb74-6761-49d9-a1d2-ad000ad187ed None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.314759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0bb74-6761-49d9-a1d2-ad000ad187ed None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.315044 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0bb74-6761-49d9-a1d2-ad000ad187ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.331525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1ac0bb74-6761-49d9-a1d2-ad000ad187ed None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:49.332793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1ac0bb74-6761-49d9-a1d2-ad000ad187ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:49.353100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ded39-c884-411e-9204-b556202b52dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:49.354683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ded39-c884-411e-9204-b556202b52dc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.355634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ded39-c884-411e-9204-b556202b52dc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.356142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ded39-c884-411e-9204-b556202b52dc None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.358364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ded39-c884-411e-9204-b556202b52dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:49.358910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ded39-c884-411e-9204-b556202b52dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:49.360567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ded39-c884-411e-9204-b556202b52dc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:49.374230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 421/851] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:49.381589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ded39-c884-411e-9204-b556202b52dc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:49.413632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 431/852] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:46:49.431187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0bb74-6761-49d9-a1d2-ad000ad187ed None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:49.485234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ded39-c884-411e-9204-b556202b52dc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:49.520109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40585124-d310-420f-8ddc-766bc8cfc3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:49.520766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40585124-d310-420f-8ddc-766bc8cfc3de None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.521045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40585124-d310-420f-8ddc-766bc8cfc3de None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.521318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40585124-d310-420f-8ddc-766bc8cfc3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.522291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40585124-d310-420f-8ddc-766bc8cfc3de None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=84eb7224717643288cc61f8e6f901543) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:49.522563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40585124-d310-420f-8ddc-766bc8cfc3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:49.524035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40585124-d310-420f-8ddc-766bc8cfc3de None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:49.537687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 422/853] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:49 2022] GET /identity/v3/role_assignments?user.id=84eb7224717643288cc61f8e6f901543&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=d03e020b3fb34446bbf5893b28904483 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:49.539059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0bb74-6761-49d9-a1d2-ad000ad187ed None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:49.581395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c482292-88d6-49cd-99a4-727af62ed767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:49.582634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482292-88d6-49cd-99a4-727af62ed767 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.583127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482292-88d6-49cd-99a4-727af62ed767 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.583613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482292-88d6-49cd-99a4-727af62ed767 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.596948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c482292-88d6-49cd-99a4-727af62ed767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-5c482292-88d6-49cd-99a4-727af62ed767 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:49.605943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:49.606963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:46:49.607855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:49.610765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 432/854] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:46:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:49.621272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40585124-d310-420f-8ddc-766bc8cfc3de None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:49.623264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ed155-9143-4e3b-940d-b4e37ac6d4ec None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.623559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ed155-9143-4e3b-940d-b4e37ac6d4ec None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.623840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ed155-9143-4e3b-940d-b4e37ac6d4ec None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.625622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 433/855] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:49.630726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88632a8-4482-4668-bce5-88bb4462d65f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.631003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88632a8-4482-4668-bce5-88bb4462d65f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.631283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88632a8-4482-4668-bce5-88bb4462d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.649189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e88632a8-4482-4668-bce5-88bb4462d65f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:49.650421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e88632a8-4482-4668-bce5-88bb4462d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:49.729866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 434/856] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:46:49.740761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40585124-d310-420f-8ddc-766bc8cfc3de None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:49.749071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88632a8-4482-4668-bce5-88bb4462d65f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:49.782452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec489-a192-48f7-9e78-53b9c708d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:49.783508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec489-a192-48f7-9e78-53b9c708d95a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.783995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec489-a192-48f7-9e78-53b9c708d95a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.784484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec489-a192-48f7-9e78-53b9c708d95a None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.785270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec489-a192-48f7-9e78-53b9c708d95a None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:49.786283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec489-a192-48f7-9e78-53b9c708d95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:49.786977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec489-a192-48f7-9e78-53b9c708d95a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:49.796292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 423/857] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:46:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:49.802426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec489-a192-48f7-9e78-53b9c708d95a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:49.868755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88632a8-4482-4668-bce5-88bb4462d65f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:49.903225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938e16e-5b24-4b89-b04a-b60d9821d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:49.903975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e16e-5b24-4b89-b04a-b60d9821d147 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.904250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e16e-5b24-4b89-b04a-b60d9821d147 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.904525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e16e-5b24-4b89-b04a-b60d9821d147 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.905037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec489-a192-48f7-9e78-53b9c708d95a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:49.905241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938e16e-5b24-4b89-b04a-b60d9821d147 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:49.906595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938e16e-5b24-4b89-b04a-b60d9821d147 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-5938e16e-5b24-4b89-b04a-b60d9821d147 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:49.919275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:49.920238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:49.921326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 435/858] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 12 18:46:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:49.927689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938e16e-5b24-4b89-b04a-b60d9821d147 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:49.944041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054d39-c831-4e4e-9251-2c3f8ff09ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:49.945105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054d39-c831-4e4e-9251-2c3f8ff09ba3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:49.945553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054d39-c831-4e4e-9251-2c3f8ff09ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:49.945993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054d39-c831-4e4e-9251-2c3f8ff09ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:49.957099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae054d39-c831-4e4e-9251-2c3f8ff09ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:49.958825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae054d39-c831-4e4e-9251-2c3f8ff09ba3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ae054d39-c831-4e4e-9251-2c3f8ff09ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:49.978702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:49.979839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:49.980933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:49.980933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:49.980933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:49.980933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:49.982843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 424/859] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:49.987923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054d39-c831-4e4e-9251-2c3f8ff09ba3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:50.056412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938e16e-5b24-4b89-b04a-b60d9821d147 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:50.095540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc5761-1698-4b4a-82cb-8f496d0c49aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:50.096203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5761-1698-4b4a-82cb-8f496d0c49aa None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:50.096485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5761-1698-4b4a-82cb-8f496d0c49aa None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:50.096760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5761-1698-4b4a-82cb-8f496d0c49aa None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:50.097461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5761-1698-4b4a-82cb-8f496d0c49aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:50.097811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5761-1698-4b4a-82cb-8f496d0c49aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:50.099244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5761-1698-4b4a-82cb-8f496d0c49aa None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:50.110710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 436/860] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:46:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:50.111833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc5761-1698-4b4a-82cb-8f496d0c49aa None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:50.115024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054d39-c831-4e4e-9251-2c3f8ff09ba3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:50.149406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e84f6-9cf1-47e2-b462-6393de3a8458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:50.150101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e84f6-9cf1-47e2-b462-6393de3a8458 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:50.150383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e84f6-9cf1-47e2-b462-6393de3a8458 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:50.150713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e84f6-9cf1-47e2-b462-6393de3a8458 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:50.151434 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e84f6-9cf1-47e2-b462-6393de3a8458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:50.151739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e84f6-9cf1-47e2-b462-6393de3a8458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:50.153094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e84f6-9cf1-47e2-b462-6393de3a8458 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:50.169851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 425/861] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:50.172346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e84f6-9cf1-47e2-b462-6393de3a8458 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:50.229442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc5761-1698-4b4a-82cb-8f496d0c49aa None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:50.262435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c95b6-0ec6-4e29-99fa-f17d77796e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:50.263063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c95b6-0ec6-4e29-99fa-f17d77796e76 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:50.263346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c95b6-0ec6-4e29-99fa-f17d77796e76 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:50.263620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c95b6-0ec6-4e29-99fa-f17d77796e76 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:50.264366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c95b6-0ec6-4e29-99fa-f17d77796e76 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:50.264675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c95b6-0ec6-4e29-99fa-f17d77796e76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:50.266672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c95b6-0ec6-4e29-99fa-f17d77796e76 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:50.277559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 437/862] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:46:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:50.305090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e84f6-9cf1-47e2-b462-6393de3a8458 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:50.343663 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef896c2-46fe-43cd-b45b-0631f05de269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:50.344647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef896c2-46fe-43cd-b45b-0631f05de269 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:50.344992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef896c2-46fe-43cd-b45b-0631f05de269 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:50.345330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef896c2-46fe-43cd-b45b-0631f05de269 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:50.354344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef896c2-46fe-43cd-b45b-0631f05de269 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:50.355966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef896c2-46fe-43cd-b45b-0631f05de269 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-3ef896c2-46fe-43cd-b45b-0631f05de269 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:50.372404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:50.373426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:50.374408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 426/863] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:46:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:50.386659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c95b6-0ec6-4e29-99fa-f17d77796e76 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:50.499523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c95b6-0ec6-4e29-99fa-f17d77796e76 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:50.534297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb32e3-c053-437a-a9e5-58e9ca1889d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:50.534961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb32e3-c053-437a-a9e5-58e9ca1889d6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:50.535237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb32e3-c053-437a-a9e5-58e9ca1889d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:50.535506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb32e3-c053-437a-a9e5-58e9ca1889d6 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:50.536330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb32e3-c053-437a-a9e5-58e9ca1889d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:50.536634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb32e3-c053-437a-a9e5-58e9ca1889d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:50.538084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb32e3-c053-437a-a9e5-58e9ca1889d6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:50.555513 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 438/864] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 12 18:46:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:50.561219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef896c2-46fe-43cd-b45b-0631f05de269 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:50.662060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef896c2-46fe-43cd-b45b-0631f05de269 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:50.697015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8294-3204-4d22-9161-29c0a9fd14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:50.698095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8294-3204-4d22-9161-29c0a9fd14aa None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:50.698601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8294-3204-4d22-9161-29c0a9fd14aa None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:50.699078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8294-3204-4d22-9161-29c0a9fd14aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:50.769632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a8294-3204-4d22-9161-29c0a9fd14aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:50.771392 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a8294-3204-4d22-9161-29c0a9fd14aa None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:50.871895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 427/865] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:46:50.877818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb32e3-c053-437a-a9e5-58e9ca1889d6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:50.978884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb32e3-c053-437a-a9e5-58e9ca1889d6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:51.014538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114e93a-a78a-473d-ad59-d825e24f3e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:51.015772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114e93a-a78a-473d-ad59-d825e24f3e7b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.016286 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114e93a-a78a-473d-ad59-d825e24f3e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.016764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114e93a-a78a-473d-ad59-d825e24f3e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.027474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114e93a-a78a-473d-ad59-d825e24f3e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:51.029176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114e93a-a78a-473d-ad59-d825e24f3e7b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-3114e93a-a78a-473d-ad59-d825e24f3e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:51.046990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:51.047870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:51.048781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:51.048781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:51.048781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:51.048781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:51.050973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 439/866] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:51.057326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8294-3204-4d22-9161-29c0a9fd14aa None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:51.161433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8294-3204-4d22-9161-29c0a9fd14aa None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:51.196372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53ad1-641d-4fba-89a3-4285727c2c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:51.197033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53ad1-641d-4fba-89a3-4285727c2c89 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.197316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53ad1-641d-4fba-89a3-4285727c2c89 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.197629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53ad1-641d-4fba-89a3-4285727c2c89 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.198350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac53ad1-641d-4fba-89a3-4285727c2c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:51.198658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac53ad1-641d-4fba-89a3-4285727c2c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:51.200016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac53ad1-641d-4fba-89a3-4285727c2c89 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:51.212068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 428/867] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:51.217445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114e93a-a78a-473d-ad59-d825e24f3e7b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:51.320399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b04b9-b779-49df-9a1f-39d0564299b9 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.320698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b04b9-b779-49df-9a1f-39d0564299b9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.320930 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b04b9-b779-49df-9a1f-39d0564299b9 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.322905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 429/868] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:46:51.324404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114e93a-a78a-473d-ad59-d825e24f3e7b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:51.329005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28b1f-14ec-4d53-bae2-dc544d8f8a62 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.329297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28b1f-14ec-4d53-bae2-dc544d8f8a62 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.329594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28b1f-14ec-4d53-bae2-dc544d8f8a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.348621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-cde28b1f-14ec-4d53-bae2-dc544d8f8a62 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:51.350637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cde28b1f-14ec-4d53-bae2-dc544d8f8a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:51.370810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de09cd-9f47-4770-8eec-82f14d67f34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:51.371609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de09cd-9f47-4770-8eec-82f14d67f34f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.371892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de09cd-9f47-4770-8eec-82f14d67f34f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.372168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de09cd-9f47-4770-8eec-82f14d67f34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.382123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de09cd-9f47-4770-8eec-82f14d67f34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:51.383880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de09cd-9f47-4770-8eec-82f14d67f34f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-67de09cd-9f47-4770-8eec-82f14d67f34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:51.401663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:51.402626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:51.403545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:51.403545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:51.403545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:51.403545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:51.403545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:51.403545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:51.403545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:51.403545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:51.405605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 440/869] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:51.408410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de09cd-9f47-4770-8eec-82f14d67f34f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:51.433689 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 430/870] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:51.453659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde28b1f-14ec-4d53-bae2-dc544d8f8a62 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:51.532646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de09cd-9f47-4770-8eec-82f14d67f34f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:51.572381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde28b1f-14ec-4d53-bae2-dc544d8f8a62 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:51.573215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc3df2-61db-4d2d-a77d-dce6efb99ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:51.573913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc3df2-61db-4d2d-a77d-dce6efb99ca9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.574195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc3df2-61db-4d2d-a77d-dce6efb99ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.574473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc3df2-61db-4d2d-a77d-dce6efb99ca9 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.575346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc3df2-61db-4d2d-a77d-dce6efb99ca9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:51.575857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc3df2-61db-4d2d-a77d-dce6efb99ca9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:51.578817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc3df2-61db-4d2d-a77d-dce6efb99ca9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:51.597719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 441/871] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:51.602209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc3df2-61db-4d2d-a77d-dce6efb99ca9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:51.616024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40abc3-1ae8-42ef-9840-145610240148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:51.616788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40abc3-1ae8-42ef-9840-145610240148 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.617764 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40abc3-1ae8-42ef-9840-145610240148 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.618019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40abc3-1ae8-42ef-9840-145610240148 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.618815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40abc3-1ae8-42ef-9840-145610240148 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:51.620183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40abc3-1ae8-42ef-9840-145610240148 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:51.641810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 431/872] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:46:51 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:46:51.728797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc3df2-61db-4d2d-a77d-dce6efb99ca9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:51.772313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1f6fb-7bb0-4d7d-ae0f-b3d95a51a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:51.772986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1f6fb-7bb0-4d7d-ae0f-b3d95a51a15f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.773825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1f6fb-7bb0-4d7d-ae0f-b3d95a51a15f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.774099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1f6fb-7bb0-4d7d-ae0f-b3d95a51a15f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.774931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1f6fb-7bb0-4d7d-ae0f-b3d95a51a15f None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=6cf36b056ece466ea23001b8d33c16a2) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:51.775239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1f6fb-7bb0-4d7d-ae0f-b3d95a51a15f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:51.776683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1f6fb-7bb0-4d7d-ae0f-b3d95a51a15f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:51.783766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 442/873] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:51 2022] GET /identity/v3/role_assignments?user.id=6cf36b056ece466ea23001b8d33c16a2&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:51.886118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaa7bf-2e02-46b7-81a0-7d95514fab20 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.886308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaa7bf-2e02-46b7-81a0-7d95514fab20 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.886591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaa7bf-2e02-46b7-81a0-7d95514fab20 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.888301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 432/874] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:51.894142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c7361-83e1-43d0-b5ea-39e64091150a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:51.894429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c7361-83e1-43d0-b5ea-39e64091150a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:51.894694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c7361-83e1-43d0-b5ea-39e64091150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:51.912876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7f6c7361-83e1-43d0-b5ea-39e64091150a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:51.914667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7f6c7361-83e1-43d0-b5ea-39e64091150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:51.986453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 443/875] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:52.020104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaa7bf-2e02-46b7-81a0-7d95514fab20 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:52.124813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaa7bf-2e02-46b7-81a0-7d95514fab20 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:52.157463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927c605-a416-47b0-8c85-8290ccd20023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:52.158621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c605-a416-47b0-8c85-8290ccd20023 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:52.159084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c605-a416-47b0-8c85-8290ccd20023 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:52.159536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c605-a416-47b0-8c85-8290ccd20023 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:52.160390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927c605-a416-47b0-8c85-8290ccd20023 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:52.162018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927c605-a416-47b0-8c85-8290ccd20023 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-6927c605-a416-47b0-8c85-8290ccd20023 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:52.175516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:52.176575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:46:52.177413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:52.180524 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 433/876] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:46:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:52.186575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c7361-83e1-43d0-b5ea-39e64091150a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:52.288434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c7361-83e1-43d0-b5ea-39e64091150a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:52.323933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba56de-6e5d-408a-84eb-aa9247348691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:52.323933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba56de-6e5d-408a-84eb-aa9247348691 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:52.324235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba56de-6e5d-408a-84eb-aa9247348691 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:52.324308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba56de-6e5d-408a-84eb-aa9247348691 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:52.325006 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba56de-6e5d-408a-84eb-aa9247348691 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:52.327297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba56de-6e5d-408a-84eb-aa9247348691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:52.327297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba56de-6e5d-408a-84eb-aa9247348691 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:52.331516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 444/877] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:46:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:52.336886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927c605-a416-47b0-8c85-8290ccd20023 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:52.442420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927c605-a416-47b0-8c85-8290ccd20023 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:52.478907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcc47b-a394-40d0-b032-932f97a74c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:52.480047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcc47b-a394-40d0-b032-932f97a74c99 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:52.480537 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcc47b-a394-40d0-b032-932f97a74c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:52.481008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcc47b-a394-40d0-b032-932f97a74c99 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:52.481942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcc47b-a394-40d0-b032-932f97a74c99 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:52.482446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcc47b-a394-40d0-b032-932f97a74c99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:52.484024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcc47b-a394-40d0-b032-932f97a74c99 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:52.489017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 434/878] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:46:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:52.559661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65715d29-a202-4b1b-9020-bd01e67fa6c3 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:52.559973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65715d29-a202-4b1b-9020-bd01e67fa6c3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:52.560215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65715d29-a202-4b1b-9020-bd01e67fa6c3 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:52.561913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 445/879] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:52.567677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a1e2-639a-4563-afff-7e8e86a3e141 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:52.567973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a1e2-639a-4563-afff-7e8e86a3e141 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:52.568228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a1e2-639a-4563-afff-7e8e86a3e141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:52.585407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fd73a1e2-639a-4563-afff-7e8e86a3e141 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:52.587195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fd73a1e2-639a-4563-afff-7e8e86a3e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:52.659270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 435/880] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:52.683116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65715d29-a202-4b1b-9020-bd01e67fa6c3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:52.790175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65715d29-a202-4b1b-9020-bd01e67fa6c3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:52.823456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a81345-fe7b-49c3-8272-f4b0e3970f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:52.824387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a81345-fe7b-49c3-8272-f4b0e3970f7f None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:52.824809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a81345-fe7b-49c3-8272-f4b0e3970f7f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:52.825224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a81345-fe7b-49c3-8272-f4b0e3970f7f None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:52.826129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a81345-fe7b-49c3-8272-f4b0e3970f7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:52.827656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a81345-fe7b-49c3-8272-f4b0e3970f7f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:52.844225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 446/881] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:46:52 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:53.971513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4fad0-d4ac-4e37-a35a-7e0c0da7276b None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:53.972045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4fad0-d4ac-4e37-a35a-7e0c0da7276b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:53.972124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4fad0-d4ac-4e37-a35a-7e0c0da7276b None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:53.973834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 436/882] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:53.980424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a44367-ec4a-4aae-9fd4-9e293cff0c6d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:53.981426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a44367-ec4a-4aae-9fd4-9e293cff0c6d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:53.981959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a44367-ec4a-4aae-9fd4-9e293cff0c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:53.999436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-46a44367-ec4a-4aae-9fd4-9e293cff0c6d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:54.000972 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-46a44367-ec4a-4aae-9fd4-9e293cff0c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:54.083192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 447/883] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:54.107154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4fad0-d4ac-4e37-a35a-7e0c0da7276b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:54.217757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4fad0-d4ac-4e37-a35a-7e0c0da7276b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:54.250028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbac372-356e-4eae-acae-cc416dcb503f None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.250747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbac372-356e-4eae-acae-cc416dcb503f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.251304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbac372-356e-4eae-acae-cc416dcb503f None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.252149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e66f7-a943-4438-81b1-8c87f5fba60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:54.252938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e66f7-a943-4438-81b1-8c87f5fba60c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.253217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e66f7-a943-4438-81b1-8c87f5fba60c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.253491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e66f7-a943-4438-81b1-8c87f5fba60c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.254059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 448/884] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:46:54.254164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e66f7-a943-4438-81b1-8c87f5fba60c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:54.258552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e66f7-a943-4438-81b1-8c87f5fba60c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:54.260012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267ac08-0195-435f-833d-bd780721a329 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.260700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267ac08-0195-435f-833d-bd780721a329 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.261181 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267ac08-0195-435f-833d-bd780721a329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-515e66f7-a943-4438-81b1-8c87f5fba60c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:54.268935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:54.269996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:54.270850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 437/885] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:54.278049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e66f7-a943-4438-81b1-8c87f5fba60c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:54.285212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7267ac08-0195-435f-833d-bd780721a329 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:54.286682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7267ac08-0195-435f-833d-bd780721a329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:54.373670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 449/886] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:54.396819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e66f7-a943-4438-81b1-8c87f5fba60c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:54.397008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267ac08-0195-435f-833d-bd780721a329 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:54.432691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c902e06-bd67-4d96-aa33-4575f370163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:54.433740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c902e06-bd67-4d96-aa33-4575f370163f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.434275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c902e06-bd67-4d96-aa33-4575f370163f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.434743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c902e06-bd67-4d96-aa33-4575f370163f None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.435656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c902e06-bd67-4d96-aa33-4575f370163f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:54.436168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c902e06-bd67-4d96-aa33-4575f370163f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:54.438187 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c902e06-bd67-4d96-aa33-4575f370163f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:54.444771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 438/887] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:54.451890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c902e06-bd67-4d96-aa33-4575f370163f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:54.510651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267ac08-0195-435f-833d-bd780721a329 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:54.547343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897b9bf-86ec-4b15-a6c7-aeb4e3722663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:54.548143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897b9bf-86ec-4b15-a6c7-aeb4e3722663 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.548429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897b9bf-86ec-4b15-a6c7-aeb4e3722663 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.548677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897b9bf-86ec-4b15-a6c7-aeb4e3722663 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.559988 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897b9bf-86ec-4b15-a6c7-aeb4e3722663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-6897b9bf-86ec-4b15-a6c7-aeb4e3722663 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:54.568557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:54.569629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:46:54.571104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:54.575321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 450/888] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 12 18:46:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:54.576457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897b9bf-86ec-4b15-a6c7-aeb4e3722663 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:54.582433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c902e06-bd67-4d96-aa33-4575f370163f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:54.627868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04541c-47c1-49e8-947c-d75c81ede141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:54.629077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04541c-47c1-49e8-947c-d75c81ede141 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.629873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04541c-47c1-49e8-947c-d75c81ede141 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.630374 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04541c-47c1-49e8-947c-d75c81ede141 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.631297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04541c-47c1-49e8-947c-d75c81ede141 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:54.631810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04541c-47c1-49e8-947c-d75c81ede141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:54.634681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04541c-47c1-49e8-947c-d75c81ede141 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:54.646581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 439/889] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:54.647640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04541c-47c1-49e8-947c-d75c81ede141 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:54.687045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897b9bf-86ec-4b15-a6c7-aeb4e3722663 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:54.720817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b82023-edde-446e-bb43-f2ca0d255489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:54.721547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b82023-edde-446e-bb43-f2ca0d255489 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.721934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b82023-edde-446e-bb43-f2ca0d255489 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.722115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b82023-edde-446e-bb43-f2ca0d255489 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.722854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b82023-edde-446e-bb43-f2ca0d255489 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:54.723368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b82023-edde-446e-bb43-f2ca0d255489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:54.724559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b82023-edde-446e-bb43-f2ca0d255489 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:54.737671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 451/890] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 12 18:46:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:54.738744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b82023-edde-446e-bb43-f2ca0d255489 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:54.770669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04541c-47c1-49e8-947c-d75c81ede141 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:54.804836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c8aca-4c37-4587-aa3d-70be0b405a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:54.805507 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c8aca-4c37-4587-aa3d-70be0b405a32 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.806287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c8aca-4c37-4587-aa3d-70be0b405a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.806569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c8aca-4c37-4587-aa3d-70be0b405a32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.807634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c8aca-4c37-4587-aa3d-70be0b405a32 None admin] RBAC: Adding query filter params (interface=public, service_id=d753bfa31db94929bcf2f850d5141ce6, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:54.807947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c8aca-4c37-4587-aa3d-70be0b405a32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:54.810179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c8aca-4c37-4587-aa3d-70be0b405a32 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:54.819610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 440/891] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 12 18:46:54 2022] GET /identity/v3/endpoints?service_id=d753bfa31db94929bcf2f850d5141ce6&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:54.819610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2282755-515c-43bc-93ef-d7862c1eb6f0 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.819610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2282755-515c-43bc-93ef-d7862c1eb6f0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.819610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2282755-515c-43bc-93ef-d7862c1eb6f0 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.819610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 441/892] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:54.821258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2282755-515c-43bc-93ef-d7862c1eb6f0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:54.843926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b82023-edde-446e-bb43-f2ca0d255489 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:54.878047 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabc963-3a29-4a3f-9e83-cf812ad89402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:54.878985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabc963-3a29-4a3f-9e83-cf812ad89402 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.879269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabc963-3a29-4a3f-9e83-cf812ad89402 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.879854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabc963-3a29-4a3f-9e83-cf812ad89402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.892656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabc963-3a29-4a3f-9e83-cf812ad89402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:54.894128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabc963-3a29-4a3f-9e83-cf812ad89402 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-ffabc963-3a29-4a3f-9e83-cf812ad89402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:54.911215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:54.912213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:54.913119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:54.913119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:54.913119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:54.913119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:54.913119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 452/893] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:54.914141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b40136-78d8-4853-a20a-416cb30d12ba None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.914351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b40136-78d8-4853-a20a-416cb30d12ba None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.914624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b40136-78d8-4853-a20a-416cb30d12ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.927334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2282755-515c-43bc-93ef-d7862c1eb6f0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:54.932927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-a3b40136-78d8-4853-a20a-416cb30d12ba None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:54.934217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a3b40136-78d8-4853-a20a-416cb30d12ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:54.963042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b215b5-72f8-4c10-8f03-2faecc3021e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:54.963708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b215b5-72f8-4c10-8f03-2faecc3021e7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:54.963998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b215b5-72f8-4c10-8f03-2faecc3021e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:54.964282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b215b5-72f8-4c10-8f03-2faecc3021e7 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:54.964971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b215b5-72f8-4c10-8f03-2faecc3021e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:54.966377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b215b5-72f8-4c10-8f03-2faecc3021e7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:54.981549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 442/894] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 12 18:46:54 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:46:54.981549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b215b5-72f8-4c10-8f03-2faecc3021e7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.011635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 453/895] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:55.039535 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b40136-78d8-4853-a20a-416cb30d12ba None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.113346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b215b5-72f8-4c10-8f03-2faecc3021e7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:55.149387 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcdbb8-45ee-49ed-b659-0993b65f9bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:55.149765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b40136-78d8-4853-a20a-416cb30d12ba None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:55.150095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcdbb8-45ee-49ed-b659-0993b65f9bfa None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.150376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcdbb8-45ee-49ed-b659-0993b65f9bfa None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.150649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcdbb8-45ee-49ed-b659-0993b65f9bfa None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.151380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcdbb8-45ee-49ed-b659-0993b65f9bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:55.151683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcdbb8-45ee-49ed-b659-0993b65f9bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:55.153052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcdbb8-45ee-49ed-b659-0993b65f9bfa None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:55.167351 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 443/896] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:55.170006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82d4e-a250-4aae-81f9-f399c9b7aa4b None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.170006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82d4e-a250-4aae-81f9-f399c9b7aa4b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.170209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82d4e-a250-4aae-81f9-f399c9b7aa4b None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.172955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 444/897] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:55.172955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b82d4e-a250-4aae-81f9-f399c9b7aa4b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.190198 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2051fa-9ca1-4c48-b152-0f1975cbf7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:55.190874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2051fa-9ca1-4c48-b152-0f1975cbf7fb None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.191217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2051fa-9ca1-4c48-b152-0f1975cbf7fb None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.191490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2051fa-9ca1-4c48-b152-0f1975cbf7fb None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.192283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2051fa-9ca1-4c48-b152-0f1975cbf7fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:55.193729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2051fa-9ca1-4c48-b152-0f1975cbf7fb None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:55.208205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 454/898] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:46:55 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:46:55.209870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a643-2be2-4448-bce9-27625a6eb568 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.210147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a643-2be2-4448-bce9-27625a6eb568 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.210451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a643-2be2-4448-bce9-27625a6eb568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.227564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6e57a643-2be2-4448-bce9-27625a6eb568 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:55.228751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6e57a643-2be2-4448-bce9-27625a6eb568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:55.285710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b82d4e-a250-4aae-81f9-f399c9b7aa4b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:55.337704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 455/899] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:55.339876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6378-61d0-426f-9394-5a4266d27df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:55.340718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6378-61d0-426f-9394-5a4266d27df1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.340997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6378-61d0-426f-9394-5a4266d27df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.341269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6378-61d0-426f-9394-5a4266d27df1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.349388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6378-61d0-426f-9394-5a4266d27df1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:55.350948 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6378-61d0-426f-9394-5a4266d27df1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:55.359329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a643-2be2-4448-bce9-27625a6eb568 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-04be6378-61d0-426f-9394-5a4266d27df1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:46:55.375644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:55.376687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:46:55.377709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:55.379008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 445/900] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:46:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:55.384826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6378-61d0-426f-9394-5a4266d27df1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.481043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a643-2be2-4448-bce9-27625a6eb568 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:55.496792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6378-61d0-426f-9394-5a4266d27df1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:55.522204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d12e8-480a-4f84-bc3c-9b314a674692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:55.523858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d12e8-480a-4f84-bc3c-9b314a674692 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.524407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d12e8-480a-4f84-bc3c-9b314a674692 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.524688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d12e8-480a-4f84-bc3c-9b314a674692 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.525506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d12e8-480a-4f84-bc3c-9b314a674692 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:55.527394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d12e8-480a-4f84-bc3c-9b314a674692 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:55.535633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f22d50-adf9-43e4-a408-eff6d19c8134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:55.536305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22d50-adf9-43e4-a408-eff6d19c8134 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.536582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22d50-adf9-43e4-a408-eff6d19c8134 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.536853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22d50-adf9-43e4-a408-eff6d19c8134 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.537716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f22d50-adf9-43e4-a408-eff6d19c8134 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:55.538119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f22d50-adf9-43e4-a408-eff6d19c8134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:55.540109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f22d50-adf9-43e4-a408-eff6d19c8134 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-fb0d12e8-480a-4f84-bc3c-9b314a674692 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:55.541099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:55.542118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 18:46:55.542993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:55.543817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 456/901] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 12 18:46:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:55.550058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d12e8-480a-4f84-bc3c-9b314a674692 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.563042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 446/902] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 12 18:46:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:55.568077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f22d50-adf9-43e4-a408-eff6d19c8134 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.659996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d12e8-480a-4f84-bc3c-9b314a674692 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:55.671111 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f22d50-adf9-43e4-a408-eff6d19c8134 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:55.696037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ebfb9-9578-43bd-83f0-75b316acce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:55.697512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ebfb9-9578-43bd-83f0-75b316acce71 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.698340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ebfb9-9578-43bd-83f0-75b316acce71 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.698845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ebfb9-9578-43bd-83f0-75b316acce71 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.700233 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ebfb9-9578-43bd-83f0-75b316acce71 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:55.701025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ebfb9-9578-43bd-83f0-75b316acce71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:55.702952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ebfb9-9578-43bd-83f0-75b316acce71 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:55.704649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae02dd-14fd-4f9d-bbcb-a7616c26be27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:55.705433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae02dd-14fd-4f9d-bbcb-a7616c26be27 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.705636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae02dd-14fd-4f9d-bbcb-a7616c26be27 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.705956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae02dd-14fd-4f9d-bbcb-a7616c26be27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.715801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 457/903] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:46:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:55.716964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ebfb9-9578-43bd-83f0-75b316acce71 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.779895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae02dd-14fd-4f9d-bbcb-a7616c26be27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:55.781598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae02dd-14fd-4f9d-bbcb-a7616c26be27 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:55.819284 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ebfb9-9578-43bd-83f0-75b316acce71 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:55.863040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b093493-bb85-479d-99b1-db142c0bcf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:55.864080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b093493-bb85-479d-99b1-db142c0bcf97 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:55.864568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b093493-bb85-479d-99b1-db142c0bcf97 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:55.865059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b093493-bb85-479d-99b1-db142c0bcf97 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:55.866027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b093493-bb85-479d-99b1-db142c0bcf97 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:55.866556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b093493-bb85-479d-99b1-db142c0bcf97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:55.868334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b093493-bb85-479d-99b1-db142c0bcf97 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:55.878590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 458/904] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:46:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:55.879796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b093493-bb85-479d-99b1-db142c0bcf97 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.889612 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 447/905] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:46:55 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:46:55.894040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae02dd-14fd-4f9d-bbcb-a7616c26be27 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:55.988147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b093493-bb85-479d-99b1-db142c0bcf97 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:55.994448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae02dd-14fd-4f9d-bbcb-a7616c26be27 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:56.021856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6fad5-fbce-4ea3-972b-28f2d248b040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:56.022369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6fad5-fbce-4ea3-972b-28f2d248b040 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:56.022647 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6fad5-fbce-4ea3-972b-28f2d248b040 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:56.023329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6fad5-fbce-4ea3-972b-28f2d248b040 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:56.024119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6fad5-fbce-4ea3-972b-28f2d248b040 None admin] RBAC: Adding query filter params (interface=public, service_id=69084b56402841cbb374e089cceaa028, region_id=RegionOne) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:56.024433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6fad5-fbce-4ea3-972b-28f2d248b040 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:56.025826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6fad5-fbce-4ea3-972b-28f2d248b040 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:56.036150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 459/906] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 12 18:46:55 2022] GET /identity/v3/endpoints?service_id=69084b56402841cbb374e089cceaa028&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:56.040341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c552d7a-dd92-43d7-835a-4df232286070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:56.041154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c552d7a-dd92-43d7-835a-4df232286070 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:56.041438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c552d7a-dd92-43d7-835a-4df232286070 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:56.041742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c552d7a-dd92-43d7-835a-4df232286070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:56.042578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6fad5-fbce-4ea3-972b-28f2d248b040 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:56.053370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c552d7a-dd92-43d7-835a-4df232286070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:56.055571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c552d7a-dd92-43d7-835a-4df232286070 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-8c552d7a-dd92-43d7-835a-4df232286070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:56.073741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:56.074701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:56.075623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:56.075623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:56.075623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:56.075623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:56.075623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 448/907] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:56.081276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c552d7a-dd92-43d7-835a-4df232286070 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:56.157135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6fad5-fbce-4ea3-972b-28f2d248b040 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:56.182274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c552d7a-dd92-43d7-835a-4df232286070 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:56.197612 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f2a86-18a7-419a-9641-380a087ad19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:56.198640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f2a86-18a7-419a-9641-380a087ad19f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:56.199129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f2a86-18a7-419a-9641-380a087ad19f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:56.199605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f2a86-18a7-419a-9641-380a087ad19f None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:56.200516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f2a86-18a7-419a-9641-380a087ad19f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:56.202129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f2a86-18a7-419a-9641-380a087ad19f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:56.213750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 460/908] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 12 18:46:56 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:46:56.217048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a84a-d558-4440-8ad4-fd2cd4858753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:56.217760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a84a-d558-4440-8ad4-fd2cd4858753 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:56.218042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a84a-d558-4440-8ad4-fd2cd4858753 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:56.218316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a84a-d558-4440-8ad4-fd2cd4858753 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:56.219088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4a84a-d558-4440-8ad4-fd2cd4858753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:56.219361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4a84a-d558-4440-8ad4-fd2cd4858753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:56.220754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4a84a-d558-4440-8ad4-fd2cd4858753 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:56.234605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 449/909] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:56.240485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f2a86-18a7-419a-9641-380a087ad19f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:56.350920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f2a86-18a7-419a-9641-380a087ad19f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:56.388282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da14e-904c-4636-b1e1-ca785e94d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:56.389489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da14e-904c-4636-b1e1-ca785e94d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:56.390027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da14e-904c-4636-b1e1-ca785e94d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:56.390510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da14e-904c-4636-b1e1-ca785e94d4b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:56.398710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991da14e-904c-4636-b1e1-ca785e94d4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:56.400086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991da14e-904c-4636-b1e1-ca785e94d4b1 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-991da14e-904c-4636-b1e1-ca785e94d4b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:46:56.417803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:56.419183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:56.420446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:46:56.420446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:46:56.420446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:46:56.420446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:46:56.420446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:46:56.420446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:46:56.420446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:46:56.420446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:56.420446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 461/910] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:56.425500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a84a-d558-4440-8ad4-fd2cd4858753 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:56.533158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a84a-d558-4440-8ad4-fd2cd4858753 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:56.568451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1942-4b59-4294-b4bc-ef7c0ebaa4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:56.569463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1942-4b59-4294-b4bc-ef7c0ebaa4e4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:56.570026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1942-4b59-4294-b4bc-ef7c0ebaa4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:56.570527 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1942-4b59-4294-b4bc-ef7c0ebaa4e4 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:56.571518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1942-4b59-4294-b4bc-ef7c0ebaa4e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:56.572031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1942-4b59-4294-b4bc-ef7c0ebaa4e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:56.573801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1942-4b59-4294-b4bc-ef7c0ebaa4e4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:56.586830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 450/911] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:56.593568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da14e-904c-4636-b1e1-ca785e94d4b1 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:56.703511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da14e-904c-4636-b1e1-ca785e94d4b1 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:56.738424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7de49-6259-4ff3-bfbd-a6eddee6e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:56.739459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7de49-6259-4ff3-bfbd-a6eddee6e064 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:56.739958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7de49-6259-4ff3-bfbd-a6eddee6e064 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:56.740453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7de49-6259-4ff3-bfbd-a6eddee6e064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:56.741517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7de49-6259-4ff3-bfbd-a6eddee6e064 None admin] RBAC: Adding query filter params (role.id=a096f9f4b98445a0b52eb5d99eb757c1, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=6cf36b056ece466ea23001b8d33c16a2) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:56.742672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7de49-6259-4ff3-bfbd-a6eddee6e064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:56.744310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7de49-6259-4ff3-bfbd-a6eddee6e064 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:56.750436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 462/912] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:46:56 2022] GET /identity/v3/role_assignments?user.id=6cf36b056ece466ea23001b8d33c16a2&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=a096f9f4b98445a0b52eb5d99eb757c1 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:57.304929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cad381-d294-4ace-b636-b6d9a6132bb9 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:57.305482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cad381-d294-4ace-b636-b6d9a6132bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:57.305482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cad381-d294-4ace-b636-b6d9a6132bb9 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:57.307079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 451/913] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:57.312415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454249bb-2e6f-48a7-a7c3-96b16b7c174e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:57.312827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454249bb-2e6f-48a7-a7c3-96b16b7c174e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:57.313002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454249bb-2e6f-48a7-a7c3-96b16b7c174e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:57.329835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-454249bb-2e6f-48a7-a7c3-96b16b7c174e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:57.331007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-454249bb-2e6f-48a7-a7c3-96b16b7c174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:57.401243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 463/914] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:57.424124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cad381-d294-4ace-b636-b6d9a6132bb9 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:57.533850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cad381-d294-4ace-b636-b6d9a6132bb9 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:57.561489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8271c9-310d-4e01-9331-52f28cef595a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:57.561730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8271c9-310d-4e01-9331-52f28cef595a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:57.562019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8271c9-310d-4e01-9331-52f28cef595a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:57.565118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 464/915] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:57.568896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b568f9-ed1a-4f5a-99a5-d494c92cfad9 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:57.569189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b568f9-ed1a-4f5a-99a5-d494c92cfad9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:57.569470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b568f9-ed1a-4f5a-99a5-d494c92cfad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:57.571297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d178bf-a268-4b6a-a1a9-219a6f80739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:57.572349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d178bf-a268-4b6a-a1a9-219a6f80739f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:57.572868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d178bf-a268-4b6a-a1a9-219a6f80739f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:57.573382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d178bf-a268-4b6a-a1a9-219a6f80739f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:57.574274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d178bf-a268-4b6a-a1a9-219a6f80739f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:57.577106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d178bf-a268-4b6a-a1a9-219a6f80739f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:57.587348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c4b568f9-ed1a-4f5a-99a5-d494c92cfad9 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:57.588543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c4b568f9-ed1a-4f5a-99a5-d494c92cfad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-a7d178bf-a268-4b6a-a1a9-219a6f80739f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:57.592574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:57.594047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 18:46:57.595220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:57.598778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 452/916] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:57.607060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d178bf-a268-4b6a-a1a9-219a6f80739f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:57.673425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 465/917] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:46:57.696593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b568f9-ed1a-4f5a-99a5-d494c92cfad9 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:57.722685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d178bf-a268-4b6a-a1a9-219a6f80739f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:57.764729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83df7da-1814-4267-9e3f-03f81bdab825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:57.765395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83df7da-1814-4267-9e3f-03f81bdab825 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:57.765744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83df7da-1814-4267-9e3f-03f81bdab825 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:57.766025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83df7da-1814-4267-9e3f-03f81bdab825 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:57.766730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83df7da-1814-4267-9e3f-03f81bdab825 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:57.767035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83df7da-1814-4267-9e3f-03f81bdab825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:57.768452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83df7da-1814-4267-9e3f-03f81bdab825 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:57.777853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 453/918] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:57.778705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83df7da-1814-4267-9e3f-03f81bdab825 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:57.815975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b568f9-ed1a-4f5a-99a5-d494c92cfad9 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:57.859859 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33c12f-7a2a-44d0-a946-71502110f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:57.860979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33c12f-7a2a-44d0-a946-71502110f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:57.861341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33c12f-7a2a-44d0-a946-71502110f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:57.861623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33c12f-7a2a-44d0-a946-71502110f6f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:57.862489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33c12f-7a2a-44d0-a946-71502110f6f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:57.864287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33c12f-7a2a-44d0-a946-71502110f6f3 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:57.878073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83df7da-1814-4267-9e3f-03f81bdab825 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-5e33c12f-7a2a-44d0-a946-71502110f6f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:57.881659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:57.883436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:46:57.884385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:57.886321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 466/919] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:46:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:46:57.890607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33c12f-7a2a-44d0-a946-71502110f6f3 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:57.927100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299612-de49-4397-a3d9-b73c5c365c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:57.928578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299612-de49-4397-a3d9-b73c5c365c94 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:57.928943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299612-de49-4397-a3d9-b73c5c365c94 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:57.929848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299612-de49-4397-a3d9-b73c5c365c94 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:57.930638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299612-de49-4397-a3d9-b73c5c365c94 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:57.931020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299612-de49-4397-a3d9-b73c5c365c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:57.932461 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299612-de49-4397-a3d9-b73c5c365c94 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:57.939089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 454/920] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 12 18:46:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:57.944155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299612-de49-4397-a3d9-b73c5c365c94 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:57.997674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33c12f-7a2a-44d0-a946-71502110f6f3 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:58.031828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9331-cba5-43de-99b0-d2cfbc32c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:58.035492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9331-cba5-43de-99b0-d2cfbc32c75e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:58.036240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9331-cba5-43de-99b0-d2cfbc32c75e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:58.036767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9331-cba5-43de-99b0-d2cfbc32c75e None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:58.037747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9331-cba5-43de-99b0-d2cfbc32c75e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:58.039012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9331-cba5-43de-99b0-d2cfbc32c75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:58.041204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9331-cba5-43de-99b0-d2cfbc32c75e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:58.048030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 467/921] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:46:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:58.055461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9331-cba5-43de-99b0-d2cfbc32c75e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:58.061469 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299612-de49-4397-a3d9-b73c5c365c94 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:58.103432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26abbae-7a27-4d55-a566-35fde0fda106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:58.104097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26abbae-7a27-4d55-a566-35fde0fda106 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:58.104379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26abbae-7a27-4d55-a566-35fde0fda106 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:58.104652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26abbae-7a27-4d55-a566-35fde0fda106 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:58.105477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26abbae-7a27-4d55-a566-35fde0fda106 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:58.107126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26abbae-7a27-4d55-a566-35fde0fda106 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:58.133551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 455/922] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 12 18:46:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:58.189830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9331-cba5-43de-99b0-d2cfbc32c75e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:58.233145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf889fec-a301-475c-89fd-f7d940284191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:58.233883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf889fec-a301-475c-89fd-f7d940284191 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:58.234134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf889fec-a301-475c-89fd-f7d940284191 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:58.234404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf889fec-a301-475c-89fd-f7d940284191 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:58.235113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf889fec-a301-475c-89fd-f7d940284191 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:58.235414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf889fec-a301-475c-89fd-f7d940284191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:58.236815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf889fec-a301-475c-89fd-f7d940284191 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:58.243523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 468/923] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:46:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:58.250659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26abbae-7a27-4d55-a566-35fde0fda106 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:58.355820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26abbae-7a27-4d55-a566-35fde0fda106 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:58.390896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c6fa0-6f2d-4ea0-861c-5467af5f49c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:58.391569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c6fa0-6f2d-4ea0-861c-5467af5f49c3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:58.391850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c6fa0-6f2d-4ea0-861c-5467af5f49c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:58.392126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c6fa0-6f2d-4ea0-861c-5467af5f49c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:58.392920 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c6fa0-6f2d-4ea0-861c-5467af5f49c3 None admin] RBAC: Adding query filter params (interface=public, service_id=64b4eff9167e4b1c91bf6a1075ceffd1, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:58.393231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c6fa0-6f2d-4ea0-861c-5467af5f49c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:58.394872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c6fa0-6f2d-4ea0-861c-5467af5f49c3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:58.403194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 456/924] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 12 18:46:58 2022] GET /identity/v3/endpoints?service_id=64b4eff9167e4b1c91bf6a1075ceffd1&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:58.408984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf889fec-a301-475c-89fd-f7d940284191 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:58.513263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf889fec-a301-475c-89fd-f7d940284191 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:58.547471 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50073316-2d08-4b6c-a112-1e4fa757f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:58.548137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50073316-2d08-4b6c-a112-1e4fa757f17a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:58.548416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50073316-2d08-4b6c-a112-1e4fa757f17a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:58.548687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50073316-2d08-4b6c-a112-1e4fa757f17a None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:58.549369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50073316-2d08-4b6c-a112-1e4fa757f17a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:58.550754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50073316-2d08-4b6c-a112-1e4fa757f17a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:58.557368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 469/925] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 12 18:46:58 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:46:58.600175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487578-eef2-4d24-83ec-e0b29a71acb2 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:58.600467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487578-eef2-4d24-83ec-e0b29a71acb2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:58.600752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487578-eef2-4d24-83ec-e0b29a71acb2 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:58.604398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 457/926] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:46:58.610130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af816b-f6d4-4a1b-bc51-a01909585a94 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:58.610434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af816b-f6d4-4a1b-bc51-a01909585a94 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:58.610686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af816b-f6d4-4a1b-bc51-a01909585a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:58.628946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-41af816b-f6d4-4a1b-bc51-a01909585a94 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:58.630188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-41af816b-f6d4-4a1b-bc51-a01909585a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:58.703902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 470/927] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:46:58.727731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487578-eef2-4d24-83ec-e0b29a71acb2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:58.840532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487578-eef2-4d24-83ec-e0b29a71acb2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:58.875097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d02f4-915c-4449-a97b-468534b0340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:58.875906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d02f4-915c-4449-a97b-468534b0340c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:58.876185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d02f4-915c-4449-a97b-468534b0340c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:58.876456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d02f4-915c-4449-a97b-468534b0340c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:58.877108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d02f4-915c-4449-a97b-468534b0340c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:58.878491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d02f4-915c-4449-a97b-468534b0340c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-4e4d02f4-915c-4449-a97b-468534b0340c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:58.891283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:58.892274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:58.893134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 458/928] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 12 18:46:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:58.899194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af816b-f6d4-4a1b-bc51-a01909585a94 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:58.998721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af816b-f6d4-4a1b-bc51-a01909585a94 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:59.009912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2f80f-f994-413d-96e2-1c6a5a4f1163 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:59.010206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2f80f-f994-413d-96e2-1c6a5a4f1163 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:59.010473 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2f80f-f994-413d-96e2-1c6a5a4f1163 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:59.011968 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 459/929] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:46:59.017455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74786e63-9103-4c09-83a5-36aaac9d209d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:59.018048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74786e63-9103-4c09-83a5-36aaac9d209d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:59.018532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74786e63-9103-4c09-83a5-36aaac9d209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:59.035423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-74786e63-9103-4c09-83a5-36aaac9d209d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:46:59.036943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-74786e63-9103-4c09-83a5-36aaac9d209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:46:59.037385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e6b8-58ba-4916-9830-6aff514c6ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:59.038080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e6b8-58ba-4916-9830-6aff514c6ff8 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:59.038901 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e6b8-58ba-4916-9830-6aff514c6ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:59.039184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e6b8-58ba-4916-9830-6aff514c6ff8 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:59.039893 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5e6b8-58ba-4916-9830-6aff514c6ff8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:59.040206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5e6b8-58ba-4916-9830-6aff514c6ff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:59.041660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5e6b8-58ba-4916-9830-6aff514c6ff8 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:59.047203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 471/930] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:46:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:59.052671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e6b8-58ba-4916-9830-6aff514c6ff8 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:59.124940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 460/931] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:46:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:46:59.144096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74786e63-9103-4c09-83a5-36aaac9d209d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:59.160521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e6b8-58ba-4916-9830-6aff514c6ff8 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:59.196305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64090e5-eeb7-41dc-8e40-e73c039dad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:59.197341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64090e5-eeb7-41dc-8e40-e73c039dad78 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:59.197883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64090e5-eeb7-41dc-8e40-e73c039dad78 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:59.198382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64090e5-eeb7-41dc-8e40-e73c039dad78 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:59.199329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64090e5-eeb7-41dc-8e40-e73c039dad78 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:59.199900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64090e5-eeb7-41dc-8e40-e73c039dad78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:59.201485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64090e5-eeb7-41dc-8e40-e73c039dad78 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:59.206905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 472/932] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:46:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:46:59.221638 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64090e5-eeb7-41dc-8e40-e73c039dad78 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:59.265210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74786e63-9103-4c09-83a5-36aaac9d209d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:59.308403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13134-3e41-43b6-94d9-d7f621744980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:59.309698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13134-3e41-43b6-94d9-d7f621744980 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:59.309982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13134-3e41-43b6-94d9-d7f621744980 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:59.310530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13134-3e41-43b6-94d9-d7f621744980 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:59.315012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64090e5-eeb7-41dc-8e40-e73c039dad78 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:59.325956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13134-3e41-43b6-94d9-d7f621744980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5ef13134-3e41-43b6-94d9-d7f621744980 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:46:59.337124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:59.339431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:46:59.341460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 461/933] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 12 18:46:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:59.351463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13134-3e41-43b6-94d9-d7f621744980 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:59.353078 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d35372-3d8c-4bfb-b014-246fc4573b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:59.353798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d35372-3d8c-4bfb-b014-246fc4573b35 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:59.354087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d35372-3d8c-4bfb-b014-246fc4573b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:59.354367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d35372-3d8c-4bfb-b014-246fc4573b35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:59.355155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d35372-3d8c-4bfb-b014-246fc4573b35 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:59.356576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d35372-3d8c-4bfb-b014-246fc4573b35 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:59.385953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 473/934] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 12 18:46:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:46:59.473293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13134-3e41-43b6-94d9-d7f621744980 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:59.520559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3184bfa-fde5-47f1-a994-bf2ff56b4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:59.521635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184bfa-fde5-47f1-a994-bf2ff56b4c3a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:59.522093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184bfa-fde5-47f1-a994-bf2ff56b4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:59.522518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184bfa-fde5-47f1-a994-bf2ff56b4c3a None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:59.524072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3184bfa-fde5-47f1-a994-bf2ff56b4c3a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:59.524557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3184bfa-fde5-47f1-a994-bf2ff56b4c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:59.526164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3184bfa-fde5-47f1-a994-bf2ff56b4c3a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:59.539741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 462/935] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 12 18:46:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:59.542818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d35372-3d8c-4bfb-b014-246fc4573b35 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:59.647437 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d35372-3d8c-4bfb-b014-246fc4573b35 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:59.681325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eced9-98d1-4d85-8be4-c73d3a6359a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:59.682368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eced9-98d1-4d85-8be4-c73d3a6359a1 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:59.682821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eced9-98d1-4d85-8be4-c73d3a6359a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:59.683258 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eced9-98d1-4d85-8be4-c73d3a6359a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:59.696201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eced9-98d1-4d85-8be4-c73d3a6359a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:59.697922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eced9-98d1-4d85-8be4-c73d3a6359a1 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-002eced9-98d1-4d85-8be4-c73d3a6359a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:46:59.715621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:46:59.716752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:46:59.717984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:46:59.717984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:46:59.717984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:46:59.717984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:46:59.724337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 474/936] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:46:59.725886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3184bfa-fde5-47f1-a994-bf2ff56b4c3a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:59.829019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3184bfa-fde5-47f1-a994-bf2ff56b4c3a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:46:59.863452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27aba5-73c6-45b1-b75c-305c35f553fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:46:59.864125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27aba5-73c6-45b1-b75c-305c35f553fe None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:46:59.864412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27aba5-73c6-45b1-b75c-305c35f553fe None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:46:59.864688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27aba5-73c6-45b1-b75c-305c35f553fe None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:46:59.865421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27aba5-73c6-45b1-b75c-305c35f553fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:46:59.865753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27aba5-73c6-45b1-b75c-305c35f553fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:46:59.867166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27aba5-73c6-45b1-b75c-305c35f553fe None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:46:59.879651 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 463/937] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:46:59.885908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eced9-98d1-4d85-8be4-c73d3a6359a1 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:46:59.992279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eced9-98d1-4d85-8be4-c73d3a6359a1 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:00.026518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84869c6-0f67-4bb5-ba83-656b0183ffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:00.027341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84869c6-0f67-4bb5-ba83-656b0183ffbd None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.027622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84869c6-0f67-4bb5-ba83-656b0183ffbd None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.027902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84869c6-0f67-4bb5-ba83-656b0183ffbd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.035551 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84869c6-0f67-4bb5-ba83-656b0183ffbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:00.036999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84869c6-0f67-4bb5-ba83-656b0183ffbd None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-d84869c6-0f67-4bb5-ba83-656b0183ffbd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:47:00.051844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:00.052831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:00.054803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 475/938] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:46:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:00.061372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27aba5-73c6-45b1-b75c-305c35f553fe None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:00.173785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27aba5-73c6-45b1-b75c-305c35f553fe None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:00.207327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dc6f7-8333-4c2f-8371-c84aa4edcf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:00.207994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc6f7-8333-4c2f-8371-c84aa4edcf53 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.208272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc6f7-8333-4c2f-8371-c84aa4edcf53 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.208540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc6f7-8333-4c2f-8371-c84aa4edcf53 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.209373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dc6f7-8333-4c2f-8371-c84aa4edcf53 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:00.209704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dc6f7-8333-4c2f-8371-c84aa4edcf53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:00.211144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dc6f7-8333-4c2f-8371-c84aa4edcf53 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:00.232411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 464/939] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 12 18:47:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:00.238596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84869c6-0f67-4bb5-ba83-656b0183ffbd None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:00.349483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84869c6-0f67-4bb5-ba83-656b0183ffbd None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:00.385121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bb43a-126c-4bab-9956-8fbdf2a1a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:00.386367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bb43a-126c-4bab-9956-8fbdf2a1a533 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.386877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bb43a-126c-4bab-9956-8fbdf2a1a533 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.387400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bb43a-126c-4bab-9956-8fbdf2a1a533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.398650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bb43a-126c-4bab-9956-8fbdf2a1a533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:00.400340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bb43a-126c-4bab-9956-8fbdf2a1a533 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-cb5bb43a-126c-4bab-9956-8fbdf2a1a533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:00.418146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:00.419058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:00.419948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:00.419948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:00.419948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:00.419948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:00.426600 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 476/940] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:00.430611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dc6f7-8333-4c2f-8371-c84aa4edcf53 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:00.483228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f693-3955-4675-85ef-26b869b2742c None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.483557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f693-3955-4675-85ef-26b869b2742c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.483789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f693-3955-4675-85ef-26b869b2742c None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.485289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 477/941] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:47:00.490387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a9ed9-487d-4ec3-87f6-8877918e899f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.490919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a9ed9-487d-4ec3-87f6-8877918e899f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.491984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a9ed9-487d-4ec3-87f6-8877918e899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.508888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7f2a9ed9-487d-4ec3-87f6-8877918e899f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:00.510182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7f2a9ed9-487d-4ec3-87f6-8877918e899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:00.547137 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dc6f7-8333-4c2f-8371-c84aa4edcf53 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:00.586449 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 478/942] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:00.590217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d43f6-b6fb-4450-a4fb-cf54db454c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:00.590882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d43f6-b6fb-4450-a4fb-cf54db454c50 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.591161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d43f6-b6fb-4450-a4fb-cf54db454c50 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.591429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d43f6-b6fb-4450-a4fb-cf54db454c50 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.592155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d43f6-b6fb-4450-a4fb-cf54db454c50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:00.592458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d43f6-b6fb-4450-a4fb-cf54db454c50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:00.593849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d43f6-b6fb-4450-a4fb-cf54db454c50 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:00.606390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 465/943] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:00.611994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a9ed9-487d-4ec3-87f6-8877918e899f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:00.614585 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d43f6-b6fb-4450-a4fb-cf54db454c50 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:00.719484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a9ed9-487d-4ec3-87f6-8877918e899f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:00.733698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d43f6-b6fb-4450-a4fb-cf54db454c50 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:00.757776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fdc1a-e343-4901-b41b-58b262d005f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:00.758603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fdc1a-e343-4901-b41b-58b262d005f2 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.758884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fdc1a-e343-4901-b41b-58b262d005f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.759162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fdc1a-e343-4901-b41b-58b262d005f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.766758 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fdc1a-e343-4901-b41b-58b262d005f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:00.768346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fdc1a-e343-4901-b41b-58b262d005f2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:00.770762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:00.771491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.771839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.772176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.773484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:00.774994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:00.776422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WARNING keystone.server.flask.common [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-3b1fdc1a-e343-4901-b41b-58b262d005f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:47:00.783412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:00.784536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:00.786456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:47:00.786456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:47:00.786456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:47:00.786456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:47:00.786456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:47:00.786456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:47:00.786456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:00.786456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:00.789999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 479/944] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:00.791201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fdc1a-e343-4901-b41b-58b262d005f2 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:00.796765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.sql.core [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 18:47:00.796765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 18:47:00.796765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [parameters: {'id': 'ef1ebab34c604f83afbe561d86b96d16', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 18:47:00.796765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79833) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef1ebab34c604f83afbe561d86b96d16.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef1ebab34c604f83afbe561d86b96d16. May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application result = self._query(query) May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application conn.query(q) May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 18:47:00.816581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application result.read() May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 18:47:00.818093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application next(self.gen) May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application yield resource May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application next(self.gen) May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self.session.rollback() May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self.force_reraise() May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise self.value May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application session.commit() May 12 18:47:00.819913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._prepare_impl() May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self.session.flush() May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._flush(objects) May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application compat.raise_( May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application flush_context.execute() May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 18:47:00.821999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rec.execute(self) May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 18:47:00.824078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application result = self._query(query) May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application conn.query(q) May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application result.read() May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 18:47:00.830626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [parameters: {'id': 'ef1ebab34c604f83afbe561d86b96d16', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:00.832865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:00.834766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef1ebab34c604f83afbe561d86b96d16. May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 466/945] 10.222.0.48 () {60 vars in 1140 bytes} [Thu May 12 18:47:00 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:00.837400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:00.906450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fdc1a-e343-4901-b41b-58b262d005f2 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:00.946488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028c44c-efae-49ff-80d4-85e28bb8b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:00.947141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c44c-efae-49ff-80d4-85e28bb8b938 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.947427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c44c-efae-49ff-80d4-85e28bb8b938 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.947688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c44c-efae-49ff-80d4-85e28bb8b938 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.948461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028c44c-efae-49ff-80d4-85e28bb8b938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:00.948766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028c44c-efae-49ff-80d4-85e28bb8b938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:00.950216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028c44c-efae-49ff-80d4-85e28bb8b938 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:00.967212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 480/946] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:47:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:00.967212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d35ae4-7d89-4fb4-8599-69ae593b3e3a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:00.967212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d35ae4-7d89-4fb4-8599-69ae593b3e3a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:00.967212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d35ae4-7d89-4fb4-8599-69ae593b3e3a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:00.967212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 481/947] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:00.968669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d35ae4-7d89-4fb4-8599-69ae593b3e3a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:00.974233 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc0bb-2701-4021-b8e5-993d3d5d4625 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:01.008018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356000c-f5aa-407e-8b1a-9ff33c5151f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:01.008814 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356000c-f5aa-407e-8b1a-9ff33c5151f5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.009150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356000c-f5aa-407e-8b1a-9ff33c5151f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.009432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356000c-f5aa-407e-8b1a-9ff33c5151f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.016823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356000c-f5aa-407e-8b1a-9ff33c5151f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:01.019065 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356000c-f5aa-407e-8b1a-9ff33c5151f5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-0356000c-f5aa-407e-8b1a-9ff33c5151f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:47:01.037150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:01.038359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 467/948] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b70c0e-7686-46f1-a2b0-1412ffce069f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.044074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b70c0e-7686-46f1-a2b0-1412ffce069f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.044724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b70c0e-7686-46f1-a2b0-1412ffce069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.060493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-35b70c0e-7686-46f1-a2b0-1412ffce069f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:01.062042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-35b70c0e-7686-46f1-a2b0-1412ffce069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:01.075628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d35ae4-7d89-4fb4-8599-69ae593b3e3a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:01.108775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dedf7-6289-469a-b13b-234317303591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:01.109672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dedf7-6289-469a-b13b-234317303591 None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.109996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dedf7-6289-469a-b13b-234317303591 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.110264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dedf7-6289-469a-b13b-234317303591 None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/6cf36b056ece466ea23001b8d33c16a2/roles/a096f9f4b98445a0b52eb5d99eb757c1` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.112520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dedf7-6289-469a-b13b-234317303591 None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=6cf36b056ece466ea23001b8d33c16a2, role_id=a096f9f4b98445a0b52eb5d99eb757c1)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:01.114018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dedf7-6289-469a-b13b-234317303591 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:01.128075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 482/949] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:47:00 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/6cf36b056ece466ea23001b8d33c16a2/roles/a096f9f4b98445a0b52eb5d99eb757c1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:47:01.129011 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dedf7-6289-469a-b13b-234317303591 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:01.136520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 468/950] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:01.160931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b70c0e-7686-46f1-a2b0-1412ffce069f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:01.270465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dedf7-6289-469a-b13b-234317303591 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:01.295182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b70c0e-7686-46f1-a2b0-1412ffce069f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:01.316132 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe914ee-e723-46c0-9dce-1a0eddc73444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:01.316862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe914ee-e723-46c0-9dce-1a0eddc73444 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.317156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe914ee-e723-46c0-9dce-1a0eddc73444 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.317432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe914ee-e723-46c0-9dce-1a0eddc73444 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.319221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe914ee-e723-46c0-9dce-1a0eddc73444 None admin] RBAC: Adding query filter params (name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:01.320069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe914ee-e723-46c0-9dce-1a0eddc73444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:01.321515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe914ee-e723-46c0-9dce-1a0eddc73444 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:01.338099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0423da-3226-45a9-a3c4-b44b6b91a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:01.339453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0423da-3226-45a9-a3c4-b44b6b91a320 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.339793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0423da-3226-45a9-a3c4-b44b6b91a320 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.340081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0423da-3226-45a9-a3c4-b44b6b91a320 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.340918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0423da-3226-45a9-a3c4-b44b6b91a320 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:01.342464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0423da-3226-45a9-a3c4-b44b6b91a320 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:01.343279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 483/951] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:47:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-df0423da-3226-45a9-a3c4-b44b6b91a320 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:01.356262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:01.357355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:47:01.358253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:01.361611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 469/952] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:47:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:01.364426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe914ee-e723-46c0-9dce-1a0eddc73444 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:01.487971 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe914ee-e723-46c0-9dce-1a0eddc73444 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:01.526640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c7cc0-358b-49b0-bd1c-5412fcf9814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:01.526877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7cc0-358b-49b0-bd1c-5412fcf9814c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.527104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7cc0-358b-49b0-bd1c-5412fcf9814c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.527289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7cc0-358b-49b0-bd1c-5412fcf9814c None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.528006 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c7cc0-358b-49b0-bd1c-5412fcf9814c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:01.528314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c7cc0-358b-49b0-bd1c-5412fcf9814c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:01.529916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c7cc0-358b-49b0-bd1c-5412fcf9814c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:01.539613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 484/953] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:47:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:01.540954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0423da-3226-45a9-a3c4-b44b6b91a320 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:01.641779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0423da-3226-45a9-a3c4-b44b6b91a320 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:01.680362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde19d1b-ebc9-4630-aecc-045d239a27ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:01.681049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde19d1b-ebc9-4630-aecc-045d239a27ee None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.681332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde19d1b-ebc9-4630-aecc-045d239a27ee None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.681636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde19d1b-ebc9-4630-aecc-045d239a27ee None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.682355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde19d1b-ebc9-4630-aecc-045d239a27ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:01.682663 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde19d1b-ebc9-4630-aecc-045d239a27ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:01.684041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde19d1b-ebc9-4630-aecc-045d239a27ee None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:01.697573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 470/954] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:47:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:01.698915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c7cc0-358b-49b0-bd1c-5412fcf9814c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:01.803701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c7cc0-358b-49b0-bd1c-5412fcf9814c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:01.839028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd1b6-4645-47ce-b124-2ca0d3f94acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:01.839681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd1b6-4645-47ce-b124-2ca0d3f94acc None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.839956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd1b6-4645-47ce-b124-2ca0d3f94acc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.840228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd1b6-4645-47ce-b124-2ca0d3f94acc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.840966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedd1b6-4645-47ce-b124-2ca0d3f94acc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:01.842349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedd1b6-4645-47ce-b124-2ca0d3f94acc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:01.843829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e63aad-1bcb-4b5f-a13e-3232c4149b6e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.844121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e63aad-1bcb-4b5f-a13e-3232c4149b6e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.844400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e63aad-1bcb-4b5f-a13e-3232c4149b6e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.846006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 471/955] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:01.851715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8beed-ec43-4174-b008-0f18d9888336 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:01.852001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8beed-ec43-4174-b008-0f18d9888336 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:01.852279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8beed-ec43-4174-b008-0f18d9888336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:01.862380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 485/956] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 12 18:47:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:01.874300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-09c8beed-ec43-4174-b008-0f18d9888336 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:01.875594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-09c8beed-ec43-4174-b008-0f18d9888336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:01.959630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 472/957] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:01.982620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd1b6-4645-47ce-b124-2ca0d3f94acc None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:02.089740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd1b6-4645-47ce-b124-2ca0d3f94acc None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:02.129103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e8745-45a0-47d6-a518-54830438a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:02.129921 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e8745-45a0-47d6-a518-54830438a1fe None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:02.130198 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e8745-45a0-47d6-a518-54830438a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:02.130467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e8745-45a0-47d6-a518-54830438a1fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:02.131167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e8745-45a0-47d6-a518-54830438a1fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:02.132626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e8745-45a0-47d6-a518-54830438a1fe None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-017e8745-45a0-47d6-a518-54830438a1fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:02.144314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:02.145306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:02.146193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 486/958] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:47:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:02.152381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8beed-ec43-4174-b008-0f18d9888336 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:02.251318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8beed-ec43-4174-b008-0f18d9888336 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:02.285150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2d24b-030c-4ddf-a9f6-190579e3fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:02.285846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2d24b-030c-4ddf-a9f6-190579e3fd6c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:02.286125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2d24b-030c-4ddf-a9f6-190579e3fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:02.286393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2d24b-030c-4ddf-a9f6-190579e3fd6c None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:02.287098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2d24b-030c-4ddf-a9f6-190579e3fd6c None admin] RBAC: Adding query filter params (name=compute) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:02.287402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2d24b-030c-4ddf-a9f6-190579e3fd6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:02.289372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2d24b-030c-4ddf-a9f6-190579e3fd6c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:02.294451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 473/959] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:47:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:02.300333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e8745-45a0-47d6-a518-54830438a1fe None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:02.402406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e8745-45a0-47d6-a518-54830438a1fe None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:02.436472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe61e4-bb3d-4793-96c9-7f5db58810fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:02.437138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe61e4-bb3d-4793-96c9-7f5db58810fe None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:02.437413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe61e4-bb3d-4793-96c9-7f5db58810fe None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:02.437795 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe61e4-bb3d-4793-96c9-7f5db58810fe None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:02.438466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe61e4-bb3d-4793-96c9-7f5db58810fe None admin] RBAC: Adding query filter params (type=compute) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:02.438767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe61e4-bb3d-4793-96c9-7f5db58810fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:02.440119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe61e4-bb3d-4793-96c9-7f5db58810fe None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:02.445146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 487/960] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:47:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:03.487530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5946-6d41-440a-b976-3f9d928e16b9 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:03.488608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5946-6d41-440a-b976-3f9d928e16b9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:03.489092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5946-6d41-440a-b976-3f9d928e16b9 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:03.492106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 474/961] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:03.498263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28635d3-4a32-4f72-a9cd-57220836a888 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:03.499244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28635d3-4a32-4f72-a9cd-57220836a888 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:03.499770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28635d3-4a32-4f72-a9cd-57220836a888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:03.517678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c28635d3-4a32-4f72-a9cd-57220836a888 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:03.519182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c28635d3-4a32-4f72-a9cd-57220836a888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:03.597766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 488/962] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:03.619346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd5946-6d41-440a-b976-3f9d928e16b9 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:03.722033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd5946-6d41-440a-b976-3f9d928e16b9 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:03.722489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de479bcf-5418-4e76-b772-35435d78c569 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:03.722780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de479bcf-5418-4e76-b772-35435d78c569 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:03.723056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de479bcf-5418-4e76-b772-35435d78c569 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:03.724651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 489/963] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:03.730137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79fc1-ea1a-447c-8d68-255cecfab272 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:03.730423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79fc1-ea1a-447c-8d68-255cecfab272 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:03.730703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79fc1-ea1a-447c-8d68-255cecfab272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:03.747675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9ad79fc1-ea1a-447c-8d68-255cecfab272 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:03.748803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9ad79fc1-ea1a-447c-8d68-255cecfab272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:03.760408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2e36f-b128-47cc-b7cb-a39170618bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:03.761504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2e36f-b128-47cc-b7cb-a39170618bf2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:03.761806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2e36f-b128-47cc-b7cb-a39170618bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:03.762081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2e36f-b128-47cc-b7cb-a39170618bf2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:03.777649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2e36f-b128-47cc-b7cb-a39170618bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-41d2e36f-b128-47cc-b7cb-a39170618bf2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:03.791381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:03.792382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:47:03.793264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:03.793952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 475/964] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 12 18:47:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:03.802656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2e36f-b128-47cc-b7cb-a39170618bf2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:03.825630 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 490/965] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:03.843748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79fc1-ea1a-447c-8d68-255cecfab272 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:03.929456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2e36f-b128-47cc-b7cb-a39170618bf2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:03.954290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79fc1-ea1a-447c-8d68-255cecfab272 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:03.971586 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52f1ce-8bf3-4b91-be5e-fad511e21fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:03.972279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52f1ce-8bf3-4b91-be5e-fad511e21fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:03.972559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52f1ce-8bf3-4b91-be5e-fad511e21fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:03.972833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52f1ce-8bf3-4b91-be5e-fad511e21fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:03.973889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52f1ce-8bf3-4b91-be5e-fad511e21fc9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:03.974199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52f1ce-8bf3-4b91-be5e-fad511e21fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:03.977788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52f1ce-8bf3-4b91-be5e-fad511e21fc9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:03.987421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 476/966] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 12 18:47:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:03.996707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52f1ce-8bf3-4b91-be5e-fad511e21fc9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.000940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.001744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.002130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.002563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.003383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.004960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.006409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING keystone.server.flask.common [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 18:47:04.023800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.sql.core [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 18:47:04.023800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 18:47:04.023800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [parameters: {'user_id': '69c5c92dd85c4e39be79cc823f0f4b64', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 18:47:04.023800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79834) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application result = self._query(query) May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application conn.query(q) May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application result.read() May 12 18:47:04.031057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 18:47:04.031975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application next(self.gen) May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application yield resource May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application next(self.gen) May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.session.rollback() May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.force_reraise() May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise self.value May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application session.commit() May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 18:47:04.032985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._prepare_impl() May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.session.flush() May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._flush(objects) May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application compat.raise_( May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application flush_context.execute() May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rec.execute(self) May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 18:47:04.034488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 18:47:04.035711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application result = self._query(query) May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application conn.query(q) May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application result.read() May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 18:47:04.036575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [parameters: {'user_id': '69c5c92dd85c4e39be79cc823f0f4b64', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:04.037433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 18:47:04.039091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 18:47:04.040229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 18:47:04.040229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 18:47:04.040229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 18:47:04.040229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 18:47:04.040229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 18:47:04.040229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:04.040229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 491/967] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 12 18:47:03 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:04.040229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.129355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52f1ce-8bf3-4b91-be5e-fad511e21fc9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:04.160874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c65cd-d35d-4a33-910b-5d69134ebe57 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:04.165657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed74e6-d55f-42dd-9b92-7efcf279eed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.166728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed74e6-d55f-42dd-9b92-7efcf279eed8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.169380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed74e6-d55f-42dd-9b92-7efcf279eed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.169941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed74e6-d55f-42dd-9b92-7efcf279eed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.182139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed74e6-d55f-42dd-9b92-7efcf279eed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.183596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed74e6-d55f-42dd-9b92-7efcf279eed8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.199193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03566f3f-bee1-4a41-b52c-fb427db79094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.199979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566f3f-bee1-4a41-b52c-fb427db79094 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.200260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566f3f-bee1-4a41-b52c-fb427db79094 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c5ed74e6-d55f-42dd-9b92-7efcf279eed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:04.200371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:04.201194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:04.202199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:04.202199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:04.202199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:04.202199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:04.202426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566f3f-bee1-4a41-b52c-fb427db79094 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.206286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 477/968] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:04.207364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3d3da-84bb-4930-a427-3f27f6fad2c7 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.207664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3d3da-84bb-4930-a427-3f27f6fad2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.207949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3d3da-84bb-4930-a427-3f27f6fad2c7 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.209502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 478/969] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:04.210259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3d3da-84bb-4930-a427-3f27f6fad2c7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.214403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03566f3f-bee1-4a41-b52c-fb427db79094 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.216182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03566f3f-bee1-4a41-b52c-fb427db79094 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-03566f3f-bee1-4a41-b52c-fb427db79094 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:47:04.231110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:04.232351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 492/970] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc147fcd-224c-4bc8-8460-4d11227274da None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.233874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc147fcd-224c-4bc8-8460-4d11227274da None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.234632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc147fcd-224c-4bc8-8460-4d11227274da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.251189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-bc147fcd-224c-4bc8-8460-4d11227274da None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:04.252626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bc147fcd-224c-4bc8-8460-4d11227274da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:04.320395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 493/971] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:04.320741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3d3da-84bb-4930-a427-3f27f6fad2c7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:04.321867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc147fcd-224c-4bc8-8460-4d11227274da None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.362076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba3e92-abdb-438b-9007-4d1c80a23677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.363098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba3e92-abdb-438b-9007-4d1c80a23677 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.363544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba3e92-abdb-438b-9007-4d1c80a23677 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.363969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba3e92-abdb-438b-9007-4d1c80a23677 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.364838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba3e92-abdb-438b-9007-4d1c80a23677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:04.365309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba3e92-abdb-438b-9007-4d1c80a23677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.367357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba3e92-abdb-438b-9007-4d1c80a23677 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.378845 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 479/972] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:04.379695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba3e92-abdb-438b-9007-4d1c80a23677 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.438599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc147fcd-224c-4bc8-8460-4d11227274da None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:04.472479 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf607-deb4-44c5-bab8-a5c84b4df8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.473218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf607-deb4-44c5-bab8-a5c84b4df8f9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.473572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf607-deb4-44c5-bab8-a5c84b4df8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.473857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf607-deb4-44c5-bab8-a5c84b4df8f9 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.474711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acf607-deb4-44c5-bab8-a5c84b4df8f9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:04.475027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acf607-deb4-44c5-bab8-a5c84b4df8f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.477042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acf607-deb4-44c5-bab8-a5c84b4df8f9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.480421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba3e92-abdb-438b-9007-4d1c80a23677 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:04.512464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aabb4-197b-45e4-9162-c056debd2398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.513186 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aabb4-197b-45e4-9162-c056debd2398 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.513470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aabb4-197b-45e4-9162-c056debd2398 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.513775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aabb4-197b-45e4-9162-c056debd2398 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.514426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aabb4-197b-45e4-9162-c056debd2398 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.515532 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 494/973] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:04.515923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aabb4-197b-45e4-9162-c056debd2398 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.516970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf607-deb4-44c5-bab8-a5c84b4df8f9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-356aabb4-197b-45e4-9162-c056debd2398 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:04.551426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:04.552628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:04.553648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 480/974] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:04.559514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aabb4-197b-45e4-9162-c056debd2398 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.672037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf607-deb4-44c5-bab8-a5c84b4df8f9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:04.676261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aabb4-197b-45e4-9162-c056debd2398 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:04.714858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7104682-61f5-43fc-b9ee-843acc628d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.715801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7104682-61f5-43fc-b9ee-843acc628d76 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.716246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7104682-61f5-43fc-b9ee-843acc628d76 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.716670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7104682-61f5-43fc-b9ee-843acc628d76 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.717556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7104682-61f5-43fc-b9ee-843acc628d76 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:04.717892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7104682-61f5-43fc-b9ee-843acc628d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.718480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93a8ab-02c5-4261-a482-d17d12014b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.719270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7104682-61f5-43fc-b9ee-843acc628d76 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.719372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93a8ab-02c5-4261-a482-d17d12014b39 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.719561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93a8ab-02c5-4261-a482-d17d12014b39 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.719835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93a8ab-02c5-4261-a482-d17d12014b39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.724970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 481/975] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:04.728523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93a8ab-02c5-4261-a482-d17d12014b39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.730609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7104682-61f5-43fc-b9ee-843acc628d76 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.731397 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93a8ab-02c5-4261-a482-d17d12014b39 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-3c93a8ab-02c5-4261-a482-d17d12014b39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:47:04.748526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:04.749752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:04.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 495/976] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:04.751667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bcb70-8fc5-4068-bbac-ee01deef80f0 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.751738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bcb70-8fc5-4068-bbac-ee01deef80f0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.752000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bcb70-8fc5-4068-bbac-ee01deef80f0 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.753301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 496/977] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:04.755178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bcb70-8fc5-4068-bbac-ee01deef80f0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.841929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7104682-61f5-43fc-b9ee-843acc628d76 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:04.857883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bcb70-8fc5-4068-bbac-ee01deef80f0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:04.874332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44a388-ec75-42ef-8b03-d5c1649bd3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.874996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a388-ec75-42ef-8b03-d5c1649bd3d5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.875281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a388-ec75-42ef-8b03-d5c1649bd3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.875557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a388-ec75-42ef-8b03-d5c1649bd3d5 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.876265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a388-ec75-42ef-8b03-d5c1649bd3d5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:04.876571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a388-ec75-42ef-8b03-d5c1649bd3d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.877956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a388-ec75-42ef-8b03-d5c1649bd3d5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.882598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 482/978] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:04.883827 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2209522-f5b7-48c6-b424-eaeb87e1eeee None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.884123 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2209522-f5b7-48c6-b424-eaeb87e1eeee None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.884409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2209522-f5b7-48c6-b424-eaeb87e1eeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.891760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33793fae-9935-417b-90f1-ff293ca4b233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:04.892428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33793fae-9935-417b-90f1-ff293ca4b233 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:04.892709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33793fae-9935-417b-90f1-ff293ca4b233 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:04.892984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33793fae-9935-417b-90f1-ff293ca4b233 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:04.893871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33793fae-9935-417b-90f1-ff293ca4b233 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:04.894181 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33793fae-9935-417b-90f1-ff293ca4b233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:04.895586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33793fae-9935-417b-90f1-ff293ca4b233 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:04.901896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e2209522-f5b7-48c6-b424-eaeb87e1eeee None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:04.903078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e2209522-f5b7-48c6-b424-eaeb87e1eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:04.912152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 497/979] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:04.912926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33793fae-9935-417b-90f1-ff293ca4b233 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:04.965908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 483/980] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:04.966733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2209522-f5b7-48c6-b424-eaeb87e1eeee None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:05.010076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33793fae-9935-417b-90f1-ff293ca4b233 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:05.041585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e12708-6c60-4395-9594-e596f2dcaa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:05.042224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e12708-6c60-4395-9594-e596f2dcaa83 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:05.042502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e12708-6c60-4395-9594-e596f2dcaa83 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:05.042771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e12708-6c60-4395-9594-e596f2dcaa83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:05.043550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e12708-6c60-4395-9594-e596f2dcaa83 None admin] RBAC: Adding query filter params (interface=admin, service_id=64b4eff9167e4b1c91bf6a1075ceffd1, region_id=RegionOne) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:05.043856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e12708-6c60-4395-9594-e596f2dcaa83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:05.045203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e12708-6c60-4395-9594-e596f2dcaa83 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:05.050324 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 498/981] 10.222.0.48 () {56 vars in 1249 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/endpoints?service_id=64b4eff9167e4b1c91bf6a1075ceffd1&interface=admin®ion_id=RegionOne => generated 193 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:05.051058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e12708-6c60-4395-9594-e596f2dcaa83 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:05.062242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2209522-f5b7-48c6-b424-eaeb87e1eeee None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:05.093591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27348e64-5144-4954-a4d2-0b2c89c306ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:05.094239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27348e64-5144-4954-a4d2-0b2c89c306ce None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:05.094518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27348e64-5144-4954-a4d2-0b2c89c306ce None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:05.094787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27348e64-5144-4954-a4d2-0b2c89c306ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:05.148821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e12708-6c60-4395-9594-e596f2dcaa83 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:05.160722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27348e64-5144-4954-a4d2-0b2c89c306ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:05.162206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27348e64-5144-4954-a4d2-0b2c89c306ce None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:05.182999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bbe3b-a677-4b86-affa-cade8d9a9a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:05.183659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bbe3b-a677-4b86-affa-cade8d9a9a21 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:05.183943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bbe3b-a677-4b86-affa-cade8d9a9a21 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:05.184220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bbe3b-a677-4b86-affa-cade8d9a9a21 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:05.184930 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bbe3b-a677-4b86-affa-cade8d9a9a21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:05.186321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bbe3b-a677-4b86-affa-cade8d9a9a21 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:05.200267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 499/982] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:47:05 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:05.201058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bbe3b-a677-4b86-affa-cade8d9a9a21 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:05.266474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 484/983] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:04 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:47:05.271915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27348e64-5144-4954-a4d2-0b2c89c306ce None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:05.322562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bbe3b-a677-4b86-affa-cade8d9a9a21 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:05.359036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03211934-e3d6-4ad7-80fe-a7c25b4f72a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:05.359625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03211934-e3d6-4ad7-80fe-a7c25b4f72a9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:05.359909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03211934-e3d6-4ad7-80fe-a7c25b4f72a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:05.360183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03211934-e3d6-4ad7-80fe-a7c25b4f72a9 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:05.360875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03211934-e3d6-4ad7-80fe-a7c25b4f72a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:05.362307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03211934-e3d6-4ad7-80fe-a7c25b4f72a9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:05.377270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 500/984] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 12 18:47:05 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:47:05.381715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27348e64-5144-4954-a4d2-0b2c89c306ce None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:05.421085 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc2d1-da2f-452c-a62e-379c6fda42b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:05.421988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc2d1-da2f-452c-a62e-379c6fda42b1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:05.422914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc2d1-da2f-452c-a62e-379c6fda42b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:05.422914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc2d1-da2f-452c-a62e-379c6fda42b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:05.435291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfc2d1-da2f-452c-a62e-379c6fda42b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:05.436899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfc2d1-da2f-452c-a62e-379c6fda42b1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-d8dfc2d1-da2f-452c-a62e-379c6fda42b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:05.456906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:05.457969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:05.458914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:05.458914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:05.458914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:05.458914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:05.458914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 485/985] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:05.465953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03211934-e3d6-4ad7-80fe-a7c25b4f72a9 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:05.569918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03211934-e3d6-4ad7-80fe-a7c25b4f72a9 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:05.604606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55072245-f35c-4d15-ba74-6ff33370df3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:05.605270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072245-f35c-4d15-ba74-6ff33370df3b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:05.605575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072245-f35c-4d15-ba74-6ff33370df3b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:05.605851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072245-f35c-4d15-ba74-6ff33370df3b None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:05.606566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55072245-f35c-4d15-ba74-6ff33370df3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:05.606929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55072245-f35c-4d15-ba74-6ff33370df3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:05.608238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55072245-f35c-4d15-ba74-6ff33370df3b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:05.621076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 501/986] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:05.626318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc2d1-da2f-452c-a62e-379c6fda42b1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:05.723891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc2d1-da2f-452c-a62e-379c6fda42b1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:05.758351 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09ae85-8d8a-4fa9-8398-547dc3fa69ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:05.759157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09ae85-8d8a-4fa9-8398-547dc3fa69ed None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:05.759437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09ae85-8d8a-4fa9-8398-547dc3fa69ed None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:05.759714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09ae85-8d8a-4fa9-8398-547dc3fa69ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:05.766313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09ae85-8d8a-4fa9-8398-547dc3fa69ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:05.767744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09ae85-8d8a-4fa9-8398-547dc3fa69ed None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-7c09ae85-8d8a-4fa9-8398-547dc3fa69ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:47:05.781168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:05.782289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:05.783185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:47:05.783185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:47:05.783185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:47:05.783185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:47:05.783185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:47:05.783185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:47:05.783185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:05.783185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:05.785607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 486/987] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:05.788652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55072245-f35c-4d15-ba74-6ff33370df3b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:05.884077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55072245-f35c-4d15-ba74-6ff33370df3b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:05.917785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbb1ce-c9be-404b-800e-5ca4e1c3c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:05.918440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbb1ce-c9be-404b-800e-5ca4e1c3c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:05.918718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbb1ce-c9be-404b-800e-5ca4e1c3c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:05.918990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbb1ce-c9be-404b-800e-5ca4e1c3c5f4 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:05.919761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbb1ce-c9be-404b-800e-5ca4e1c3c5f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:05.920061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbb1ce-c9be-404b-800e-5ca4e1c3c5f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:05.921744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbb1ce-c9be-404b-800e-5ca4e1c3c5f4 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:05.932894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 502/988] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:05.939010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09ae85-8d8a-4fa9-8398-547dc3fa69ed None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:06.034532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09ae85-8d8a-4fa9-8398-547dc3fa69ed None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:06.067307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0961cf-6b0a-4bbe-a58d-603e16fe2322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:06.067956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0961cf-6b0a-4bbe-a58d-603e16fe2322 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:06.068233 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0961cf-6b0a-4bbe-a58d-603e16fe2322 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:06.068502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0961cf-6b0a-4bbe-a58d-603e16fe2322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:06.069887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0961cf-6b0a-4bbe-a58d-603e16fe2322 None admin] RBAC: Adding query filter params (role.id=a096f9f4b98445a0b52eb5d99eb757c1, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=6cf36b056ece466ea23001b8d33c16a2) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:06.070198 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0961cf-6b0a-4bbe-a58d-603e16fe2322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:06.071628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0961cf-6b0a-4bbe-a58d-603e16fe2322 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:06.085802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 487/989] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:47:05 2022] GET /identity/v3/role_assignments?user.id=6cf36b056ece466ea23001b8d33c16a2&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=a096f9f4b98445a0b52eb5d99eb757c1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:07.485314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee06584-5b4e-4998-8e4a-ffe3f99d057c None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:07.485880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee06584-5b4e-4998-8e4a-ffe3f99d057c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:07.485880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee06584-5b4e-4998-8e4a-ffe3f99d057c None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:07.487399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 503/990] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:07.493034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd427c9f-cb43-4f32-b08d-c53da556ee8e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:07.493442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd427c9f-cb43-4f32-b08d-c53da556ee8e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:07.493690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd427c9f-cb43-4f32-b08d-c53da556ee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:07.510694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-dd427c9f-cb43-4f32-b08d-c53da556ee8e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:07.511879 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dd427c9f-cb43-4f32-b08d-c53da556ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:07.578364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 488/991] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:07.599602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df2f3a-02f0-40ce-9a89-fe63ddb96571 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:07.599910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df2f3a-02f0-40ce-9a89-fe63ddb96571 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:07.600427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df2f3a-02f0-40ce-9a89-fe63ddb96571 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:07.601389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd427c9f-cb43-4f32-b08d-c53da556ee8e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:07.601833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 504/992] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:07.606935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3bbda-40a1-4af7-9534-9192c68eb6d4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:07.607223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3bbda-40a1-4af7-9534-9192c68eb6d4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:07.607498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3bbda-40a1-4af7-9534-9192c68eb6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:07.624156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c4e3bbda-40a1-4af7-9534-9192c68eb6d4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:07.625556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c4e3bbda-40a1-4af7-9534-9192c68eb6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:07.690977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 505/993] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:07.703075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd427c9f-cb43-4f32-b08d-c53da556ee8e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:07.714134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3bbda-40a1-4af7-9534-9192c68eb6d4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:07.737028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068b1ae-1a91-4a97-9df5-e5ea3563a0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:07.738152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068b1ae-1a91-4a97-9df5-e5ea3563a0e4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:07.738611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068b1ae-1a91-4a97-9df5-e5ea3563a0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:07.739065 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068b1ae-1a91-4a97-9df5-e5ea3563a0e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:07.739914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068b1ae-1a91-4a97-9df5-e5ea3563a0e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:07.742060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068b1ae-1a91-4a97-9df5-e5ea3563a0e4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-1068b1ae-1a91-4a97-9df5-e5ea3563a0e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:07.753763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:07.754793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 18:47:07.755738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:07.763337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 489/994] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:47:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:07.764690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068b1ae-1a91-4a97-9df5-e5ea3563a0e4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:07.811167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3bbda-40a1-4af7-9534-9192c68eb6d4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:07.847607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea356b-ce54-4e45-9538-94ead9c79dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:07.848635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea356b-ce54-4e45-9538-94ead9c79dd7 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:07.849071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea356b-ce54-4e45-9538-94ead9c79dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:07.849338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea356b-ce54-4e45-9538-94ead9c79dd7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:07.850016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea356b-ce54-4e45-9538-94ead9c79dd7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:07.852297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea356b-ce54-4e45-9538-94ead9c79dd7 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-b3ea356b-ce54-4e45-9538-94ead9c79dd7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:07.863448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:07.864469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 18:47:07.865326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:07.866737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068b1ae-1a91-4a97-9df5-e5ea3563a0e4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:07.866814 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 506/995] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 12 18:47:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:07.871026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea356b-ce54-4e45-9538-94ead9c79dd7 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:07.900040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33e44-6e0b-4a4c-8eae-a813ff518383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:07.901040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33e44-6e0b-4a4c-8eae-a813ff518383 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:07.901506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33e44-6e0b-4a4c-8eae-a813ff518383 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:07.901994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33e44-6e0b-4a4c-8eae-a813ff518383 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:07.903313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33e44-6e0b-4a4c-8eae-a813ff518383 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:07.903836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33e44-6e0b-4a4c-8eae-a813ff518383 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:07.906117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33e44-6e0b-4a4c-8eae-a813ff518383 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:07.913445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 490/996] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:47:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:07.918741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33e44-6e0b-4a4c-8eae-a813ff518383 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:07.978648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea356b-ce54-4e45-9538-94ead9c79dd7 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:08.011202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3ea1-f963-4083-b5ce-f3689afa92ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:08.011789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3ea1-f963-4083-b5ce-f3689afa92ce None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.012075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3ea1-f963-4083-b5ce-f3689afa92ce None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.012346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3ea1-f963-4083-b5ce-f3689afa92ce None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.013041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3ea1-f963-4083-b5ce-f3689afa92ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:08.013346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3ea1-f963-4083-b5ce-f3689afa92ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:08.014627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33e44-6e0b-4a4c-8eae-a813ff518383 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:08.014757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3ea1-f963-4083-b5ce-f3689afa92ce None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:08.019592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 507/997] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:47:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:08.025030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3ea1-f963-4083-b5ce-f3689afa92ce None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:08.051034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e65b1-6db5-4dda-bc6d-7e1f16265d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:08.051703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e65b1-6db5-4dda-bc6d-7e1f16265d58 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.051991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e65b1-6db5-4dda-bc6d-7e1f16265d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.052266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e65b1-6db5-4dda-bc6d-7e1f16265d58 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.052973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e65b1-6db5-4dda-bc6d-7e1f16265d58 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:08.053282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e65b1-6db5-4dda-bc6d-7e1f16265d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:08.055374 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e65b1-6db5-4dda-bc6d-7e1f16265d58 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:08.060237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 491/998] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:47:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:08.065708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e65b1-6db5-4dda-bc6d-7e1f16265d58 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:08.128405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3ea1-f963-4083-b5ce-f3689afa92ce None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:08.166576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e65b1-6db5-4dda-bc6d-7e1f16265d58 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:08.168234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a900a-1e8e-4fec-b18b-57dc4613cc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:08.169210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a900a-1e8e-4fec-b18b-57dc4613cc52 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.169634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a900a-1e8e-4fec-b18b-57dc4613cc52 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.170005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a900a-1e8e-4fec-b18b-57dc4613cc52 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.172050 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a900a-1e8e-4fec-b18b-57dc4613cc52 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:08.172359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a900a-1e8e-4fec-b18b-57dc4613cc52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:08.173761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a900a-1e8e-4fec-b18b-57dc4613cc52 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:08.184887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 508/999] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 12 18:47:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:08.186224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a900a-1e8e-4fec-b18b-57dc4613cc52 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:08.201965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc8226-cfb2-4e55-a265-2ef3e8bb35da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:08.202714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8226-cfb2-4e55-a265-2ef3e8bb35da None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.202999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8226-cfb2-4e55-a265-2ef3e8bb35da None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.203272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8226-cfb2-4e55-a265-2ef3e8bb35da None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.204058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc8226-cfb2-4e55-a265-2ef3e8bb35da None admin] RBAC: Adding query filter params (interface=public, service_id=fd8d07ad09c140f09937685b36330f38, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:08.204368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc8226-cfb2-4e55-a265-2ef3e8bb35da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:08.205738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc8226-cfb2-4e55-a265-2ef3e8bb35da None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:08.215665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 492/1000] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 12 18:47:08 2022] GET /identity/v3/endpoints?service_id=fd8d07ad09c140f09937685b36330f38&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:08.216527 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc8226-cfb2-4e55-a265-2ef3e8bb35da None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:08.295260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a900a-1e8e-4fec-b18b-57dc4613cc52 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:08.321385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc8226-cfb2-4e55-a265-2ef3e8bb35da None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:08.328940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf8bad-1e80-4b38-ad3d-73b4fd819666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:08.329624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf8bad-1e80-4b38-ad3d-73b4fd819666 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.329904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf8bad-1e80-4b38-ad3d-73b4fd819666 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.330173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf8bad-1e80-4b38-ad3d-73b4fd819666 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.330896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf8bad-1e80-4b38-ad3d-73b4fd819666 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:08.332244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf8bad-1e80-4b38-ad3d-73b4fd819666 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:08.357581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 509/1001] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 12 18:47:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:08.357581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4333d22-1dc1-4d7f-ab11-1fd4fd837a1a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.357581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4333d22-1dc1-4d7f-ab11-1fd4fd837a1a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.357581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4333d22-1dc1-4d7f-ab11-1fd4fd837a1a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.357581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 510/1002] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:08.357581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e935fb3-90c4-4d9e-a62c-e4caaa0e55aa None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.357581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e935fb3-90c4-4d9e-a62c-e4caaa0e55aa None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.358240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e935fb3-90c4-4d9e-a62c-e4caaa0e55aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.360952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c33e-f9c8-4d5c-9906-f0069ebbeea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:08.362176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c33e-f9c8-4d5c-9906-f0069ebbeea5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.362176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c33e-f9c8-4d5c-9906-f0069ebbeea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.362176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c33e-f9c8-4d5c-9906-f0069ebbeea5 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.362872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6c33e-f9c8-4d5c-9906-f0069ebbeea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:08.364438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6c33e-f9c8-4d5c-9906-f0069ebbeea5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:08.377432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 493/1003] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 12 18:47:08 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 18:47:08.377675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-3e935fb3-90c4-4d9e-a62c-e4caaa0e55aa None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:08.377675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3e935fb3-90c4-4d9e-a62c-e4caaa0e55aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:08.452549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 511/1004] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:08.474971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c33e-f9c8-4d5c-9906-f0069ebbeea5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:08.584299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c33e-f9c8-4d5c-9906-f0069ebbeea5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:08.621154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abea3c-52e0-4d8d-98b8-d232179624ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:08.621992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abea3c-52e0-4d8d-98b8-d232179624ff None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.622274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abea3c-52e0-4d8d-98b8-d232179624ff None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.622547 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abea3c-52e0-4d8d-98b8-d232179624ff None admin] PATH_INFO: `/v3/services/image` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.623198 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abea3c-52e0-4d8d-98b8-d232179624ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:08.624660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abea3c-52e0-4d8d-98b8-d232179624ff None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-46abea3c-52e0-4d8d-98b8-d232179624ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:08.636506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:08.637503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:08.642324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 494/1005] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 12 18:47:08 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:08.646131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e935fb3-90c4-4d9e-a62c-e4caaa0e55aa None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:08.741211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e935fb3-90c4-4d9e-a62c-e4caaa0e55aa None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:08.774558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416419d4-e808-4d04-a0f2-706a1eccbf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:08.775220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416419d4-e808-4d04-a0f2-706a1eccbf33 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.775502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416419d4-e808-4d04-a0f2-706a1eccbf33 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.775778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416419d4-e808-4d04-a0f2-706a1eccbf33 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.776484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416419d4-e808-4d04-a0f2-706a1eccbf33 None admin] RBAC: Adding query filter params (name=image) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:08.776795 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416419d4-e808-4d04-a0f2-706a1eccbf33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:08.778193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416419d4-e808-4d04-a0f2-706a1eccbf33 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:08.787539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 512/1006] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:08.789054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abea3c-52e0-4d8d-98b8-d232179624ff None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:08.886986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abea3c-52e0-4d8d-98b8-d232179624ff None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:08.920003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cccf92-7c79-4517-aeac-ea7fe1889c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:08.921029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cccf92-7c79-4517-aeac-ea7fe1889c5e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:08.921385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cccf92-7c79-4517-aeac-ea7fe1889c5e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:08.921767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cccf92-7c79-4517-aeac-ea7fe1889c5e None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:08.922549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cccf92-7c79-4517-aeac-ea7fe1889c5e None admin] RBAC: Adding query filter params (type=image) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:08.922935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cccf92-7c79-4517-aeac-ea7fe1889c5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:08.924371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cccf92-7c79-4517-aeac-ea7fe1889c5e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:08.929609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 495/1007] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:10.593377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479fbd-f347-44b0-a8af-61e1e0273e44 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:10.593936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479fbd-f347-44b0-a8af-61e1e0273e44 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:10.593936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479fbd-f347-44b0-a8af-61e1e0273e44 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:10.594100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e17b-b202-466e-81dd-75e552eb90d6 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:10.594444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e17b-b202-466e-81dd-75e552eb90d6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:10.594843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e17b-b202-466e-81dd-75e552eb90d6 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:10.595419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 513/1008] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:10.596362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 496/1009] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:10.600761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e798f-2577-45c7-b577-3ef568559bfa None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:10.601042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e798f-2577-45c7-b577-3ef568559bfa None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:10.601314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e798f-2577-45c7-b577-3ef568559bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:10.601499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724190c9-7860-42ed-bbaf-170dc886fc7d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:10.601808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724190c9-7860-42ed-bbaf-170dc886fc7d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:10.602089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724190c9-7860-42ed-bbaf-170dc886fc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:10.619155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-724190c9-7860-42ed-bbaf-170dc886fc7d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:10.619423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-fd7e798f-2577-45c7-b577-3ef568559bfa None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:10.620341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-724190c9-7860-42ed-bbaf-170dc886fc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:10.620581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fd7e798f-2577-45c7-b577-3ef568559bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:10.687700 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 497/1010] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:10.700067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 514/1011] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:10.710942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724190c9-7860-42ed-bbaf-170dc886fc7d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:10.727005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e798f-2577-45c7-b577-3ef568559bfa None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:10.805489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724190c9-7860-42ed-bbaf-170dc886fc7d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:10.830756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e798f-2577-45c7-b577-3ef568559bfa None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:10.838069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c66e0-f5a6-4fca-bb8f-512ea3cb0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:10.838861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c66e0-f5a6-4fca-bb8f-512ea3cb0e23 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:10.839139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c66e0-f5a6-4fca-bb8f-512ea3cb0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:10.839411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c66e0-f5a6-4fca-bb8f-512ea3cb0e23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:10.840573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c66e0-f5a6-4fca-bb8f-512ea3cb0e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:10.842042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c66e0-f5a6-4fca-bb8f-512ea3cb0e23 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:10.844072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 498/1012] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:10.849319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c66e0-f5a6-4fca-bb8f-512ea3cb0e23 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:10.865694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107b4c-8928-47b2-828c-97cc934fb573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:10.866575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107b4c-8928-47b2-828c-97cc934fb573 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:10.866856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107b4c-8928-47b2-828c-97cc934fb573 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:10.867126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107b4c-8928-47b2-828c-97cc934fb573 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:10.867771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107b4c-8928-47b2-828c-97cc934fb573 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:10.869135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107b4c-8928-47b2-828c-97cc934fb573 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-bd107b4c-8928-47b2-828c-97cc934fb573 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:10.880349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:10.881973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:10.883396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 515/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:47:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:10.888520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107b4c-8928-47b2-828c-97cc934fb573 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:10.962948 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c66e0-f5a6-4fca-bb8f-512ea3cb0e23 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:10.992320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107b4c-8928-47b2-828c-97cc934fb573 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:10.996748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca9634-ae7a-4a8f-98aa-28116985c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:10.997600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca9634-ae7a-4a8f-98aa-28116985c460 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:10.998045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca9634-ae7a-4a8f-98aa-28116985c460 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:10.998475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca9634-ae7a-4a8f-98aa-28116985c460 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:10.999341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca9634-ae7a-4a8f-98aa-28116985c460 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:11.000859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca9634-ae7a-4a8f-98aa-28116985c460 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:11.027053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 499/1014] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:47:10 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:11.028359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63707a-8c5c-4838-84b9-66659e0bcfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:11.029023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63707a-8c5c-4838-84b9-66659e0bcfef None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:11.029304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63707a-8c5c-4838-84b9-66659e0bcfef None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:11.029611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63707a-8c5c-4838-84b9-66659e0bcfef None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:11.030318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63707a-8c5c-4838-84b9-66659e0bcfef None admin] RBAC: Adding query filter params (name=compute) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:11.030625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63707a-8c5c-4838-84b9-66659e0bcfef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:11.032017 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63707a-8c5c-4838-84b9-66659e0bcfef None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:11.037610 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 516/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:47:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:11.043462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca9634-ae7a-4a8f-98aa-28116985c460 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:11.137887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12aaf6-fa8e-45ed-a9c3-2d9d02abcb4e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:11.138205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12aaf6-fa8e-45ed-a9c3-2d9d02abcb4e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:11.138448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12aaf6-fa8e-45ed-a9c3-2d9d02abcb4e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:11.139830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 517/1016] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:47:11.145349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd21c3-80f4-4459-924b-c2627b361a81 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:11.145670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd21c3-80f4-4459-924b-c2627b361a81 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:11.145950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd21c3-80f4-4459-924b-c2627b361a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:11.154763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca9634-ae7a-4a8f-98aa-28116985c460 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:11.169241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1ecd21c3-80f4-4459-924b-c2627b361a81 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:11.170534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1ecd21c3-80f4-4459-924b-c2627b361a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:11.192784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33172302-0a5b-4085-93b9-b6689cfdb1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:11.194706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33172302-0a5b-4085-93b9-b6689cfdb1c1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:11.195144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33172302-0a5b-4085-93b9-b6689cfdb1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:11.195757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33172302-0a5b-4085-93b9-b6689cfdb1c1 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:11.197011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33172302-0a5b-4085-93b9-b6689cfdb1c1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:11.197469 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33172302-0a5b-4085-93b9-b6689cfdb1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:11.199069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33172302-0a5b-4085-93b9-b6689cfdb1c1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:11.204472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 500/1017] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 12 18:47:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:11.211088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33172302-0a5b-4085-93b9-b6689cfdb1c1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:11.246173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 518/1018] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:11.269262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd21c3-80f4-4459-924b-c2627b361a81 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:11.316572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33172302-0a5b-4085-93b9-b6689cfdb1c1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:11.349969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2707315-67aa-46cd-a181-6c8fcd10a3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:11.350668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707315-67aa-46cd-a181-6c8fcd10a3e0 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:11.350945 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707315-67aa-46cd-a181-6c8fcd10a3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:11.351215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707315-67aa-46cd-a181-6c8fcd10a3e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:11.351997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2707315-67aa-46cd-a181-6c8fcd10a3e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:11.353368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2707315-67aa-46cd-a181-6c8fcd10a3e0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:11.370310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd21c3-80f4-4459-924b-c2627b361a81 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:11.382318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 501/1019] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 12 18:47:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:47:11.414215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79067ca-adfb-49bf-8232-ec3ab7b4c4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:11.414886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79067ca-adfb-49bf-8232-ec3ab7b4c4b7 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:11.415163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79067ca-adfb-49bf-8232-ec3ab7b4c4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:11.415430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79067ca-adfb-49bf-8232-ec3ab7b4c4b7 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:11.416150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79067ca-adfb-49bf-8232-ec3ab7b4c4b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:11.417576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79067ca-adfb-49bf-8232-ec3ab7b4c4b7 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:11.432599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 519/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:47:11 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:47:13.298326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb0472-3084-41d7-8ce7-ae87d810eb57 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:13.298847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb0472-3084-41d7-8ce7-ae87d810eb57 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:13.298927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb0472-3084-41d7-8ce7-ae87d810eb57 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:13.300377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 502/1021] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:13.305555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe81e6-7324-42a2-8f5d-51e5c0fcd96d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:13.305982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe81e6-7324-42a2-8f5d-51e5c0fcd96d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:13.306167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe81e6-7324-42a2-8f5d-51e5c0fcd96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:13.322770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-42fe81e6-7324-42a2-8f5d-51e5c0fcd96d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:13.323928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-42fe81e6-7324-42a2-8f5d-51e5c0fcd96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:13.392952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 520/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:13.416897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb0472-3084-41d7-8ce7-ae87d810eb57 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:13.520339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb0472-3084-41d7-8ce7-ae87d810eb57 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:13.556604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2a597-16b6-4ccc-bd4f-b794f7d5d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:13.557415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2a597-16b6-4ccc-bd4f-b794f7d5d34e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:13.557720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2a597-16b6-4ccc-bd4f-b794f7d5d34e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:13.557994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2a597-16b6-4ccc-bd4f-b794f7d5d34e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:13.559257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2a597-16b6-4ccc-bd4f-b794f7d5d34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:13.560709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2a597-16b6-4ccc-bd4f-b794f7d5d34e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:13.562630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 503/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:13.568307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe81e6-7324-42a2-8f5d-51e5c0fcd96d None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:13.665373 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe81e6-7324-42a2-8f5d-51e5c0fcd96d None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:13.696941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90001-92f0-4d3e-8808-0395727b759c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:13.697254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90001-92f0-4d3e-8808-0395727b759c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:13.697442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88d02-747e-4316-a3f6-c9968a40bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:13.697592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90001-92f0-4d3e-8808-0395727b759c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:13.698069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88d02-747e-4316-a3f6-c9968a40bfa2 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:13.698343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88d02-747e-4316-a3f6-c9968a40bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:13.698609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88d02-747e-4316-a3f6-c9968a40bfa2 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:13.699015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 504/1024] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:47:13.699318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b88d02-747e-4316-a3f6-c9968a40bfa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:13.700723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b88d02-747e-4316-a3f6-c9968a40bfa2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:13.703796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e58809-7cba-48c7-9221-89cd08543479 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:13.704080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e58809-7cba-48c7-9221-89cd08543479 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:13.704351 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e58809-7cba-48c7-9221-89cd08543479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:13.729557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 521/1025] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:47:13 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:13.729816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b8e58809-7cba-48c7-9221-89cd08543479 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:13.729816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b8e58809-7cba-48c7-9221-89cd08543479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:13.758906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe879-9894-4cda-a465-fd5137321f78 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:13.759287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe879-9894-4cda-a465-fd5137321f78 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:13.759488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe879-9894-4cda-a465-fd5137321f78 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:13.760875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 522/1026] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:47:13.766667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b282f04-7a8f-482e-b10e-2c792f63774f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:13.767039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b282f04-7a8f-482e-b10e-2c792f63774f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:13.767288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b282f04-7a8f-482e-b10e-2c792f63774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:13.788154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-8b282f04-7a8f-482e-b10e-2c792f63774f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:13.789419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8b282f04-7a8f-482e-b10e-2c792f63774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:13.799529 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 505/1027] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:13.823088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e58809-7cba-48c7-9221-89cd08543479 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:13.862266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 523/1028] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:13.886569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b282f04-7a8f-482e-b10e-2c792f63774f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:13.924655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e58809-7cba-48c7-9221-89cd08543479 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:13.959877 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2313749-74b8-4c42-b4ac-0d2b3e1b52be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:13.960675 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2313749-74b8-4c42-b4ac-0d2b3e1b52be None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:13.960958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2313749-74b8-4c42-b4ac-0d2b3e1b52be None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:13.961234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2313749-74b8-4c42-b4ac-0d2b3e1b52be None admin] PATH_INFO: `/v3/services/image` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:13.961912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2313749-74b8-4c42-b4ac-0d2b3e1b52be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:13.963282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2313749-74b8-4c42-b4ac-0d2b3e1b52be None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c2313749-74b8-4c42-b4ac-0d2b3e1b52be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:13.976156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:13.977190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:13.978481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 506/1029] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 12 18:47:13 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:13.983303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2313749-74b8-4c42-b4ac-0d2b3e1b52be None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:13.992694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b282f04-7a8f-482e-b10e-2c792f63774f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.025731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5552d0b-03e4-4c99-9a4d-d143d830cf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.026868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5552d0b-03e4-4c99-9a4d-d143d830cf9c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.027427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5552d0b-03e4-4c99-9a4d-d143d830cf9c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.027875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5552d0b-03e4-4c99-9a4d-d143d830cf9c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.039412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5552d0b-03e4-4c99-9a4d-d143d830cf9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-b5552d0b-03e4-4c99-9a4d-d143d830cf9c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:14.048104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:14.049060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:47:14.050152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:14.051240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 524/1030] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 12 18:47:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:14.056451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5552d0b-03e4-4c99-9a4d-d143d830cf9c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:14.084694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2313749-74b8-4c42-b4ac-0d2b3e1b52be None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.117874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e1dfb-61a5-4af2-bc15-9c383ef2c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.118531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e1dfb-61a5-4af2-bc15-9c383ef2c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.118809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e1dfb-61a5-4af2-bc15-9c383ef2c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.119079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e1dfb-61a5-4af2-bc15-9c383ef2c4a9 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.119776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e1dfb-61a5-4af2-bc15-9c383ef2c4a9 None admin] RBAC: Adding query filter params (name=image) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:14.120078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e1dfb-61a5-4af2-bc15-9c383ef2c4a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:14.121428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e1dfb-61a5-4af2-bc15-9c383ef2c4a9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:14.133752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 507/1031] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:14.134647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e1dfb-61a5-4af2-bc15-9c383ef2c4a9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:14.156025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5552d0b-03e4-4c99-9a4d-d143d830cf9c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.194700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293ce73-f940-4f6a-9570-0ccd704e0769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.195362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ce73-f940-4f6a-9570-0ccd704e0769 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.195640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ce73-f940-4f6a-9570-0ccd704e0769 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.195918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ce73-f940-4f6a-9570-0ccd704e0769 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.196651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293ce73-f940-4f6a-9570-0ccd704e0769 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:14.196955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293ce73-f940-4f6a-9570-0ccd704e0769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:14.198345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293ce73-f940-4f6a-9570-0ccd704e0769 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:14.211370 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 525/1032] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 12 18:47:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:14.212353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293ce73-f940-4f6a-9570-0ccd704e0769 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:14.236290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e1dfb-61a5-4af2-bc15-9c383ef2c4a9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.278708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07eee4-04d2-4921-a58a-8435d8b45a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.279706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07eee4-04d2-4921-a58a-8435d8b45a3f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.280166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07eee4-04d2-4921-a58a-8435d8b45a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.280617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07eee4-04d2-4921-a58a-8435d8b45a3f None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.281500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07eee4-04d2-4921-a58a-8435d8b45a3f None admin] RBAC: Adding query filter params (type=image) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:14.282009 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07eee4-04d2-4921-a58a-8435d8b45a3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:14.283563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07eee4-04d2-4921-a58a-8435d8b45a3f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:14.288708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 508/1033] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:14.294508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07eee4-04d2-4921-a58a-8435d8b45a3f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:14.320879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293ce73-f940-4f6a-9570-0ccd704e0769 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.355227 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b6a7-ff2a-410b-8e66-dbd1a0777fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.356009 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b6a7-ff2a-410b-8e66-dbd1a0777fab None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.356290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b6a7-ff2a-410b-8e66-dbd1a0777fab None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.356563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b6a7-ff2a-410b-8e66-dbd1a0777fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.367770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1b6a7-ff2a-410b-8e66-dbd1a0777fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:14.369213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1b6a7-ff2a-410b-8e66-dbd1a0777fab None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-37d1b6a7-ff2a-410b-8e66-dbd1a0777fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:14.386546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:14.387524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:14.389163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:14.389163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:14.389163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:14.389163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:14.389163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 526/1034] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:14.393237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b6a7-ff2a-410b-8e66-dbd1a0777fab None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:14.398843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07eee4-04d2-4921-a58a-8435d8b45a3f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.431801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a73904-28e5-4454-86ab-4d77dafd536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.432457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a73904-28e5-4454-86ab-4d77dafd536c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.432743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a73904-28e5-4454-86ab-4d77dafd536c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.433021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a73904-28e5-4454-86ab-4d77dafd536c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.433906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a73904-28e5-4454-86ab-4d77dafd536c None admin] RBAC: Adding query filter params (interface=public, service_id=1fa6e77776f0464c9b674ae64e3c2aba, region_id=RegionOne) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:14.434217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a73904-28e5-4454-86ab-4d77dafd536c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:14.435592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a73904-28e5-4454-86ab-4d77dafd536c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:14.440409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 509/1035] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 12 18:47:14 2022] GET /identity/v3/endpoints?service_id=1fa6e77776f0464c9b674ae64e3c2aba&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:14.446957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a73904-28e5-4454-86ab-4d77dafd536c None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:14.492763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b6a7-ff2a-410b-8e66-dbd1a0777fab None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.526278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb2a97-e137-4645-9a09-476829d47441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.526986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb2a97-e137-4645-9a09-476829d47441 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.527267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb2a97-e137-4645-9a09-476829d47441 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.527537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb2a97-e137-4645-9a09-476829d47441 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.528245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb2a97-e137-4645-9a09-476829d47441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:14.528546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb2a97-e137-4645-9a09-476829d47441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:14.529934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb2a97-e137-4645-9a09-476829d47441 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:14.542391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 527/1036] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:14.544714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a73904-28e5-4454-86ab-4d77dafd536c None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.548097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb2a97-e137-4645-9a09-476829d47441 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:14.583275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c205590-9e59-4868-aa81-46db5dcb33e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.583937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c205590-9e59-4868-aa81-46db5dcb33e4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.584240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c205590-9e59-4868-aa81-46db5dcb33e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.584514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c205590-9e59-4868-aa81-46db5dcb33e4 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.585191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c205590-9e59-4868-aa81-46db5dcb33e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:14.586996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c205590-9e59-4868-aa81-46db5dcb33e4 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:14.595429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 510/1037] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 12 18:47:14 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 18:47:14.650611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb2a97-e137-4645-9a09-476829d47441 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.686881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704766-27c0-440c-b47e-3310b44af0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.687682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704766-27c0-440c-b47e-3310b44af0c6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.687968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704766-27c0-440c-b47e-3310b44af0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.688238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704766-27c0-440c-b47e-3310b44af0c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.696314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58704766-27c0-440c-b47e-3310b44af0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:14.697875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58704766-27c0-440c-b47e-3310b44af0c6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-58704766-27c0-440c-b47e-3310b44af0c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:47:14.713004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:14.714292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:14.715674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 528/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 12 18:47:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:14.722362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c205590-9e59-4868-aa81-46db5dcb33e4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:14.824917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c205590-9e59-4868-aa81-46db5dcb33e4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:14.857421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60af81-1654-48bf-a17d-740a5269add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:14.858623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60af81-1654-48bf-a17d-740a5269add7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:14.859050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60af81-1654-48bf-a17d-740a5269add7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:14.859563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60af81-1654-48bf-a17d-740a5269add7 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:14.860723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60af81-1654-48bf-a17d-740a5269add7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:14.861176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60af81-1654-48bf-a17d-740a5269add7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:14.863110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60af81-1654-48bf-a17d-740a5269add7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:14.885087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 511/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 12 18:47:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:14.886637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704766-27c0-440c-b47e-3310b44af0c6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:14.987466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704766-27c0-440c-b47e-3310b44af0c6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:15.021029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08776a6-493b-4ad8-8ea9-cbde271cd5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:15.022472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08776a6-493b-4ad8-8ea9-cbde271cd5a3 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:15.022899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08776a6-493b-4ad8-8ea9-cbde271cd5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:15.023313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08776a6-493b-4ad8-8ea9-cbde271cd5a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:15.088434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08776a6-493b-4ad8-8ea9-cbde271cd5a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:15.089923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08776a6-493b-4ad8-8ea9-cbde271cd5a3 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:15.195916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 529/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:47:15.197629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60af81-1654-48bf-a17d-740a5269add7 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:15.291985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60af81-1654-48bf-a17d-740a5269add7 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:15.325105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51707bd1-c61e-48dc-a92b-e6bc3eb295ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:15.325937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707bd1-c61e-48dc-a92b-e6bc3eb295ca None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:15.326223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707bd1-c61e-48dc-a92b-e6bc3eb295ca None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:15.326499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707bd1-c61e-48dc-a92b-e6bc3eb295ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:15.336838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51707bd1-c61e-48dc-a92b-e6bc3eb295ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:15.338312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51707bd1-c61e-48dc-a92b-e6bc3eb295ca None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-51707bd1-c61e-48dc-a92b-e6bc3eb295ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:15.355653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:15.356571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:15.362120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:15.362120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:15.362120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:15.362120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:15.362120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 512/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:15.363918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08776a6-493b-4ad8-8ea9-cbde271cd5a3 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:15.460877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08776a6-493b-4ad8-8ea9-cbde271cd5a3 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:15.493018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65204e-66e0-408f-916b-b22f63e050df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:15.493718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65204e-66e0-408f-916b-b22f63e050df None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:15.494018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65204e-66e0-408f-916b-b22f63e050df None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:15.494275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65204e-66e0-408f-916b-b22f63e050df None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:15.495061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65204e-66e0-408f-916b-b22f63e050df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:15.495370 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65204e-66e0-408f-916b-b22f63e050df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:15.496727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65204e-66e0-408f-916b-b22f63e050df None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:15.512419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 530/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:15.514181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51707bd1-c61e-48dc-a92b-e6bc3eb295ca None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:15.608628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51707bd1-c61e-48dc-a92b-e6bc3eb295ca None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:15.641122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076214a9-c471-46b4-807a-a4ac95249e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:15.641940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076214a9-c471-46b4-807a-a4ac95249e98 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:15.642219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076214a9-c471-46b4-807a-a4ac95249e98 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:15.642487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076214a9-c471-46b4-807a-a4ac95249e98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:15.649634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076214a9-c471-46b4-807a-a4ac95249e98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:15.651075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076214a9-c471-46b4-807a-a4ac95249e98 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-076214a9-c471-46b4-807a-a4ac95249e98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:47:15.664463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:15.665408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:15.666385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:47:15.666385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:47:15.666385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:47:15.666385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:47:15.666385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:47:15.666385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:47:15.666385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:15.666385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:15.669852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 513/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:15.671919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65204e-66e0-408f-916b-b22f63e050df None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:15.775923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65204e-66e0-408f-916b-b22f63e050df None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:15.809064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5d2e-fa64-48c8-83a9-b193913f59b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:15.809755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5d2e-fa64-48c8-83a9-b193913f59b9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:15.810037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5d2e-fa64-48c8-83a9-b193913f59b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:15.810311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5d2e-fa64-48c8-83a9-b193913f59b9 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:15.811110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b5d2e-fa64-48c8-83a9-b193913f59b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:15.811416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b5d2e-fa64-48c8-83a9-b193913f59b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:15.812889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b5d2e-fa64-48c8-83a9-b193913f59b9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:15.832946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 531/1044] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:47:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:15.834664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076214a9-c471-46b4-807a-a4ac95249e98 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:15.933782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076214a9-c471-46b4-807a-a4ac95249e98 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:15.965479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f34be5-1cca-432d-8bb2-0681bfe2b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:15.966360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f34be5-1cca-432d-8bb2-0681bfe2b133 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:15.966805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f34be5-1cca-432d-8bb2-0681bfe2b133 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:15.967243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f34be5-1cca-432d-8bb2-0681bfe2b133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:15.968201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f34be5-1cca-432d-8bb2-0681bfe2b133 None admin] RBAC: Adding query filter params (role.id=a096f9f4b98445a0b52eb5d99eb757c1, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=e2e41b41f355446c8462fafcd91c183f) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:15.968654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f34be5-1cca-432d-8bb2-0681bfe2b133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:15.970240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f34be5-1cca-432d-8bb2-0681bfe2b133 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:15.975812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 514/1045] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:47:15 2022] GET /identity/v3/role_assignments?user.id=e2e41b41f355446c8462fafcd91c183f&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=a096f9f4b98445a0b52eb5d99eb757c1 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:16.002951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cf041-fcad-4e65-878e-6c6ae6e48547 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:16.003254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cf041-fcad-4e65-878e-6c6ae6e48547 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:16.003695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cf041-fcad-4e65-878e-6c6ae6e48547 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:16.005252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 532/1046] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:16.011742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0b96d-f7a7-46a8-b6b6-8820cd5df733 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:16.012088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0b96d-f7a7-46a8-b6b6-8820cd5df733 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:16.012303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0b96d-f7a7-46a8-b6b6-8820cd5df733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:16.029297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ffe0b96d-f7a7-46a8-b6b6-8820cd5df733 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:16.030545 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ffe0b96d-f7a7-46a8-b6b6-8820cd5df733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:16.099333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 515/1047] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:16.124982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cf041-fcad-4e65-878e-6c6ae6e48547 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:16.227952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cf041-fcad-4e65-878e-6c6ae6e48547 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:16.260307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d090a5-8235-45ca-bee4-07012eef7cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:16.261097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d090a5-8235-45ca-bee4-07012eef7cc7 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:16.261375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d090a5-8235-45ca-bee4-07012eef7cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:16.261753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d090a5-8235-45ca-bee4-07012eef7cc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:16.271528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d090a5-8235-45ca-bee4-07012eef7cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-74d090a5-8235-45ca-bee4-07012eef7cc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:16.290293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:16.291548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:16.292442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 533/1048] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:47:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:16.299634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0b96d-f7a7-46a8-b6b6-8820cd5df733 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:16.395326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0b96d-f7a7-46a8-b6b6-8820cd5df733 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:16.429156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d299b9-2e01-45c7-9dd5-bb09e2ae7a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:16.429858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d299b9-2e01-45c7-9dd5-bb09e2ae7a52 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:16.430145 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d299b9-2e01-45c7-9dd5-bb09e2ae7a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:16.430423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d299b9-2e01-45c7-9dd5-bb09e2ae7a52 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:16.431172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d299b9-2e01-45c7-9dd5-bb09e2ae7a52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:16.431479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d299b9-2e01-45c7-9dd5-bb09e2ae7a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:16.432842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d299b9-2e01-45c7-9dd5-bb09e2ae7a52 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:16.445427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 516/1049] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:47:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:16.446871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d090a5-8235-45ca-bee4-07012eef7cc7 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:16.543689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d090a5-8235-45ca-bee4-07012eef7cc7 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:16.575429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eaad1-9ce3-4f35-8e78-76cb61388dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:16.576287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eaad1-9ce3-4f35-8e78-76cb61388dc7 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:16.576570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eaad1-9ce3-4f35-8e78-76cb61388dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:16.576845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eaad1-9ce3-4f35-8e78-76cb61388dc7 None admin] PATH_INFO: `/v3/users/a8523bd3d66e444d9873e3f001432ec2` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:16.590164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eaad1-9ce3-4f35-8e78-76cb61388dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=a8523bd3d66e444d9873e3f001432ec2)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:16.591602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eaad1-9ce3-4f35-8e78-76cb61388dc7 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:16.593405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 534/1050] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:16 2022] GET /identity/v3/users/a8523bd3d66e444d9873e3f001432ec2 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:16.599064 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d299b9-2e01-45c7-9dd5-bb09e2ae7a52 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:16.699876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d299b9-2e01-45c7-9dd5-bb09e2ae7a52 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:16.733082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62418436-a668-4721-8b72-7209fff20416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:16.733763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418436-a668-4721-8b72-7209fff20416 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:16.734051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418436-a668-4721-8b72-7209fff20416 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:16.734328 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418436-a668-4721-8b72-7209fff20416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:16.798889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62418436-a668-4721-8b72-7209fff20416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:16.800289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62418436-a668-4721-8b72-7209fff20416 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:16.835826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acafbfd-38d7-45b7-ace3-e7a146a73cdf None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:16.836148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acafbfd-38d7-45b7-ace3-e7a146a73cdf None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:16.836381 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acafbfd-38d7-45b7-ace3-e7a146a73cdf None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:16.837899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 535/1051] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:47:16.842574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e26e-2df8-457f-b430-c02fcc08a26a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:16.842858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e26e-2df8-457f-b430-c02fcc08a26a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:16.843135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e26e-2df8-457f-b430-c02fcc08a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:16.858988 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-40e3e26e-2df8-457f-b430-c02fcc08a26a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:16.860176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-40e3e26e-2df8-457f-b430-c02fcc08a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:16.899803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 517/1052] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:47:16.900881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62418436-a668-4721-8b72-7209fff20416 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:16.931364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 536/1053] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:16.959488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3e26e-2df8-457f-b430-c02fcc08a26a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:17.001080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62418436-a668-4721-8b72-7209fff20416 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:17.033135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52610fed-b67f-46d6-8299-9314c9729107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:17.034014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52610fed-b67f-46d6-8299-9314c9729107 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:17.034296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52610fed-b67f-46d6-8299-9314c9729107 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:17.034571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52610fed-b67f-46d6-8299-9314c9729107 None admin] PATH_INFO: `/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:17.035747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52610fed-b67f-46d6-8299-9314c9729107 None admin] RBAC: Authorizing `identity:get_project(project_id=1779fe9011ec4a88b8bb2a5183b24d3e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:17.037169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52610fed-b67f-46d6-8299-9314c9729107 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:17.039565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 518/1054] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:47:16 2022] GET /identity/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:17.045399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52610fed-b67f-46d6-8299-9314c9729107 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:17.053260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3e26e-2df8-457f-b430-c02fcc08a26a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:17.086113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3518-a5c0-4edb-b4ba-75d586c80856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:17.086916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3518-a5c0-4edb-b4ba-75d586c80856 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:17.087196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3518-a5c0-4edb-b4ba-75d586c80856 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:17.087468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3518-a5c0-4edb-b4ba-75d586c80856 None admin] PATH_INFO: `/v3/services/image` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:17.088136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf3518-a5c0-4edb-b4ba-75d586c80856 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:17.089570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf3518-a5c0-4edb-b4ba-75d586c80856 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-86cf3518-a5c0-4edb-b4ba-75d586c80856 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:17.102032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:17.103145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:17.103987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 537/1055] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 12 18:47:16 2022] GET /identity/v3/services/image => generated 86 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:17.109129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3518-a5c0-4edb-b4ba-75d586c80856 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:17.146410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52610fed-b67f-46d6-8299-9314c9729107 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:17.182507 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe4a26-f46b-4f9f-a1be-d28ae5148a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:17.183163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4a26-f46b-4f9f-a1be-d28ae5148a8a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:17.183444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4a26-f46b-4f9f-a1be-d28ae5148a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:17.183719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4a26-f46b-4f9f-a1be-d28ae5148a8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:17.184547 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe4a26-f46b-4f9f-a1be-d28ae5148a8a None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=1779fe9011ec4a88b8bb2a5183b24d3e, user.id=a8523bd3d66e444d9873e3f001432ec2) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:17.184859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe4a26-f46b-4f9f-a1be-d28ae5148a8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:17.186316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe4a26-f46b-4f9f-a1be-d28ae5148a8a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:17.192136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 519/1056] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:47:17 2022] GET /identity/v3/role_assignments?user.id=a8523bd3d66e444d9873e3f001432ec2&scope.project.id=1779fe9011ec4a88b8bb2a5183b24d3e&role.id=d03e020b3fb34446bbf5893b28904483 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:17.211234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3518-a5c0-4edb-b4ba-75d586c80856 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:17.246584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cde99-f81b-4b3f-b7f2-836c45760556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:17.247267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cde99-f81b-4b3f-b7f2-836c45760556 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:17.247545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cde99-f81b-4b3f-b7f2-836c45760556 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:17.247818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cde99-f81b-4b3f-b7f2-836c45760556 None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:17.248538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cde99-f81b-4b3f-b7f2-836c45760556 None admin] RBAC: Adding query filter params (name=image) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:17.248841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cde99-f81b-4b3f-b7f2-836c45760556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:17.250266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cde99-f81b-4b3f-b7f2-836c45760556 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:17.256875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 538/1057] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:17.262898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe4a26-f46b-4f9f-a1be-d28ae5148a8a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:17.368115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe4a26-f46b-4f9f-a1be-d28ae5148a8a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:17.401385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fa1a0-92ae-4e3e-8729-6dd78a1e519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:17.402150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fa1a0-92ae-4e3e-8729-6dd78a1e519b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:17.402460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fa1a0-92ae-4e3e-8729-6dd78a1e519b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:17.402738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fa1a0-92ae-4e3e-8729-6dd78a1e519b None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:17.403445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fa1a0-92ae-4e3e-8729-6dd78a1e519b None admin] RBAC: Adding query filter params (type=image) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:17.403752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fa1a0-92ae-4e3e-8729-6dd78a1e519b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:17.405110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fa1a0-92ae-4e3e-8729-6dd78a1e519b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:17.410019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 520/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:17.416254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cde99-f81b-4b3f-b7f2-836c45760556 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:17.511603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cde99-f81b-4b3f-b7f2-836c45760556 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:17.544463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09be79-826c-48e4-ac91-b1e8bb09998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:17.545383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09be79-826c-48e4-ac91-b1e8bb09998a None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:17.545712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09be79-826c-48e4-ac91-b1e8bb09998a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:17.545987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09be79-826c-48e4-ac91-b1e8bb09998a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:17.546732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09be79-826c-48e4-ac91-b1e8bb09998a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:17.548094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09be79-826c-48e4-ac91-b1e8bb09998a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:17.566114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 539/1059] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 12 18:47:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:18.199746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e007dd-78f8-4d4a-9ec4-248f31427d84 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:18.200259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e007dd-78f8-4d4a-9ec4-248f31427d84 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:18.200338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e007dd-78f8-4d4a-9ec4-248f31427d84 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:18.201814 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 521/1060] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:18.206928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980932a8-0c63-489c-b4ce-3f99a3e672b0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:18.207225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980932a8-0c63-489c-b4ce-3f99a3e672b0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:18.207508 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980932a8-0c63-489c-b4ce-3f99a3e672b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:18.223648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-980932a8-0c63-489c-b4ce-3f99a3e672b0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:18.224814 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-980932a8-0c63-489c-b4ce-3f99a3e672b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:18.297565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 540/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:18.318815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e007dd-78f8-4d4a-9ec4-248f31427d84 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:18.416380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e007dd-78f8-4d4a-9ec4-248f31427d84 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:18.449239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afeec5-75d8-4baa-801e-cdcd25076b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:18.450216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afeec5-75d8-4baa-801e-cdcd25076b63 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:18.450497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afeec5-75d8-4baa-801e-cdcd25076b63 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:18.450773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afeec5-75d8-4baa-801e-cdcd25076b63 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:18.460542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afeec5-75d8-4baa-801e-cdcd25076b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c7afeec5-75d8-4baa-801e-cdcd25076b63 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:18.468542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:18.469470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:47:18.470393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:18.473857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 522/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 12 18:47:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:18.476356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980932a8-0c63-489c-b4ce-3f99a3e672b0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:18.568084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980932a8-0c63-489c-b4ce-3f99a3e672b0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:18.600152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a2b1d-2bb7-4c16-ac3d-29114532ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:18.600806 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a2b1d-2bb7-4c16-ac3d-29114532ec01 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:18.601084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a2b1d-2bb7-4c16-ac3d-29114532ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:18.601352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a2b1d-2bb7-4c16-ac3d-29114532ec01 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:18.602107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a2b1d-2bb7-4c16-ac3d-29114532ec01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:18.602413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a2b1d-2bb7-4c16-ac3d-29114532ec01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:18.603879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a2b1d-2bb7-4c16-ac3d-29114532ec01 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:18.616598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 541/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 12 18:47:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:18.618190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afeec5-75d8-4baa-801e-cdcd25076b63 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:18.715953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afeec5-75d8-4baa-801e-cdcd25076b63 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:18.750959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a89f4-eb71-47a0-a702-76ffbd89cd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:18.751743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a89f4-eb71-47a0-a702-76ffbd89cd97 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:18.752021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a89f4-eb71-47a0-a702-76ffbd89cd97 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:18.752290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a89f4-eb71-47a0-a702-76ffbd89cd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:18.765147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a89f4-eb71-47a0-a702-76ffbd89cd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:18.766629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a89f4-eb71-47a0-a702-76ffbd89cd97 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-da1a89f4-eb71-47a0-a702-76ffbd89cd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:18.784041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:18.784950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:18.786279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:18.786279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:18.786279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:18.786279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:18.789664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 523/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:18.791966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a2b1d-2bb7-4c16-ac3d-29114532ec01 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:18.889883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a2b1d-2bb7-4c16-ac3d-29114532ec01 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:18.922862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9667d0f-9665-4cc1-b8b4-5926268d864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:18.923520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9667d0f-9665-4cc1-b8b4-5926268d864c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:18.923799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9667d0f-9665-4cc1-b8b4-5926268d864c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:18.924068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9667d0f-9665-4cc1-b8b4-5926268d864c None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:18.924778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9667d0f-9665-4cc1-b8b4-5926268d864c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:18.925080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9667d0f-9665-4cc1-b8b4-5926268d864c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:18.926473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9667d0f-9665-4cc1-b8b4-5926268d864c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:18.942489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 542/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:18.944132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a89f4-eb71-47a0-a702-76ffbd89cd97 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:19.044838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a89f4-eb71-47a0-a702-76ffbd89cd97 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:19.085155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1d6c0-506a-49ad-b3f0-30d10854485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:19.085980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d6c0-506a-49ad-b3f0-30d10854485f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.086266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d6c0-506a-49ad-b3f0-30d10854485f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.086541 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d6c0-506a-49ad-b3f0-30d10854485f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.094657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1d6c0-506a-49ad-b3f0-30d10854485f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:19.096104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1d6c0-506a-49ad-b3f0-30d10854485f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e4a1d6c0-506a-49ad-b3f0-30d10854485f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:47:19.109779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:19.110718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:19.116258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 524/1066] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 12 18:47:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:19.118308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9667d0f-9665-4cc1-b8b4-5926268d864c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:19.220980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9667d0f-9665-4cc1-b8b4-5926268d864c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:19.261212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8febc5-2673-4717-b373-04ffee06a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:19.261937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8febc5-2673-4717-b373-04ffee06a9ab None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.262217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8febc5-2673-4717-b373-04ffee06a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.262486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8febc5-2673-4717-b373-04ffee06a9ab None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.263338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8febc5-2673-4717-b373-04ffee06a9ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:19.263645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8febc5-2673-4717-b373-04ffee06a9ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:19.265113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8febc5-2673-4717-b373-04ffee06a9ab None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:19.288684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 543/1067] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 12 18:47:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:19.290299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1d6c0-506a-49ad-b3f0-30d10854485f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:19.385741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1d6c0-506a-49ad-b3f0-30d10854485f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:19.417925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db1d97-7210-47d6-bf03-8bb12b4ef4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:19.418718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db1d97-7210-47d6-bf03-8bb12b4ef4f1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.418998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db1d97-7210-47d6-bf03-8bb12b4ef4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.419273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db1d97-7210-47d6-bf03-8bb12b4ef4f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.430373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db1d97-7210-47d6-bf03-8bb12b4ef4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:19.431096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655834-fe5c-44ac-87d5-287d76007913 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.431387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655834-fe5c-44ac-87d5-287d76007913 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.431668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655834-fe5c-44ac-87d5-287d76007913 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.431829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db1d97-7210-47d6-bf03-8bb12b4ef4f1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:19.433169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 544/1068] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:19.437897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41c679-1a19-4e5d-b5ef-8fc59ac62bd7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.438208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41c679-1a19-4e5d-b5ef-8fc59ac62bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.438452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41c679-1a19-4e5d-b5ef-8fc59ac62bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c3db1d97-7210-47d6-bf03-8bb12b4ef4f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:19.449499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:19.450495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:19.451404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:19.451404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:19.451404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:19.451404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:19.455409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 525/1069] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:19.455519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2f41c679-1a19-4e5d-b5ef-8fc59ac62bd7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:19.456059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db1d97-7210-47d6-bf03-8bb12b4ef4f1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:19.456567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2f41c679-1a19-4e5d-b5ef-8fc59ac62bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:19.522669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 545/1070] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:19.545271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41c679-1a19-4e5d-b5ef-8fc59ac62bd7 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:19.551314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db1d97-7210-47d6-bf03-8bb12b4ef4f1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:19.588548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bcc1e-def1-41f1-ab1f-cbfc7647cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:19.589214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bcc1e-def1-41f1-ab1f-cbfc7647cd32 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.589500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bcc1e-def1-41f1-ab1f-cbfc7647cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.589805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bcc1e-def1-41f1-ab1f-cbfc7647cd32 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.590532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bcc1e-def1-41f1-ab1f-cbfc7647cd32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:19.590840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bcc1e-def1-41f1-ab1f-cbfc7647cd32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:19.592197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bcc1e-def1-41f1-ab1f-cbfc7647cd32 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:19.605315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 526/1071] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:19.610457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bcc1e-def1-41f1-ab1f-cbfc7647cd32 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:19.647043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41c679-1a19-4e5d-b5ef-8fc59ac62bd7 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:19.683501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55693c24-3da6-47df-a967-191d2ce20892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:19.684298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55693c24-3da6-47df-a967-191d2ce20892 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.684579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55693c24-3da6-47df-a967-191d2ce20892 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.684851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55693c24-3da6-47df-a967-191d2ce20892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.695817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55693c24-3da6-47df-a967-191d2ce20892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-55693c24-3da6-47df-a967-191d2ce20892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:19.703403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:19.704354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:19.705217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:19.709685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 546/1072] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:47:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:19.710338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55693c24-3da6-47df-a967-191d2ce20892 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:19.714044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bcc1e-def1-41f1-ab1f-cbfc7647cd32 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:19.747005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa2a8-8a47-42b9-8631-eb1dff261917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:19.747800 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa2a8-8a47-42b9-8631-eb1dff261917 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.748083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa2a8-8a47-42b9-8631-eb1dff261917 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.748362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa2a8-8a47-42b9-8631-eb1dff261917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.755305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fa2a8-8a47-42b9-8631-eb1dff261917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:19.757304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fa2a8-8a47-42b9-8631-eb1dff261917 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-ab0fa2a8-8a47-42b9-8631-eb1dff261917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:47:19.770640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:19.771597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:19.772551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:47:19.772551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:47:19.772551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:47:19.772551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:47:19.772551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:47:19.772551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:47:19.772551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:19.772551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:19.772551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 527/1073] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:19.777587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa2a8-8a47-42b9-8631-eb1dff261917 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:19.813953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55693c24-3da6-47df-a967-191d2ce20892 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:19.846531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d5f8b-bfb2-4c58-ace8-437b314b8360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:19.847037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5f8b-bfb2-4c58-ace8-437b314b8360 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.847317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5f8b-bfb2-4c58-ace8-437b314b8360 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.847593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5f8b-bfb2-4c58-ace8-437b314b8360 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.848328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d5f8b-bfb2-4c58-ace8-437b314b8360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:19.848632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d5f8b-bfb2-4c58-ace8-437b314b8360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:19.850555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d5f8b-bfb2-4c58-ace8-437b314b8360 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:19.859079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 547/1074] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:47:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:19.860206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822b57-3942-4be2-aa59-e56ee5bbc4d6 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.860497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822b57-3942-4be2-aa59-e56ee5bbc4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.860775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822b57-3942-4be2-aa59-e56ee5bbc4d6 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.862129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 548/1075] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:19.864733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36822b57-3942-4be2-aa59-e56ee5bbc4d6 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:19.876114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa2a8-8a47-42b9-8631-eb1dff261917 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:19.907194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8836-a298-4061-91e3-2256b2ee31f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:19.907774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8836-a298-4061-91e3-2256b2ee31f3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.908051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8836-a298-4061-91e3-2256b2ee31f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.908321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8836-a298-4061-91e3-2256b2ee31f3 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.909096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b8836-a298-4061-91e3-2256b2ee31f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:19.909403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b8836-a298-4061-91e3-2256b2ee31f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:19.910858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b8836-a298-4061-91e3-2256b2ee31f3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:19.923334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 528/1076] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:19.923334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f276-ce48-49c2-ac76-4e66a513c647 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.923334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f276-ce48-49c2-ac76-4e66a513c647 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.923334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f276-ce48-49c2-ac76-4e66a513c647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.941850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6011f276-ce48-49c2-ac76-4e66a513c647 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:19.943021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6011f276-ce48-49c2-ac76-4e66a513c647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:19.962118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36822b57-3942-4be2-aa59-e56ee5bbc4d6 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:19.994928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e5eaf-b98b-4086-8f38-327d96ff0b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:19.995775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e5eaf-b98b-4086-8f38-327d96ff0b6d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:19.996057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e5eaf-b98b-4086-8f38-327d96ff0b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:19.996333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e5eaf-b98b-4086-8f38-327d96ff0b6d None admin] PATH_INFO: `/v3/users/a8523bd3d66e444d9873e3f001432ec2` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:19.997547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e5eaf-b98b-4086-8f38-327d96ff0b6d None admin] RBAC: Authorizing `identity:get_user(user_id=a8523bd3d66e444d9873e3f001432ec2)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:19.998971 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e5eaf-b98b-4086-8f38-327d96ff0b6d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:20.000595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 549/1077] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:19 2022] GET /identity/v3/users/a8523bd3d66e444d9873e3f001432ec2 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:20.001435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e5eaf-b98b-4086-8f38-327d96ff0b6d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:20.006709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 529/1078] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:20.007811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f276-ce48-49c2-ac76-4e66a513c647 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:20.101840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e5eaf-b98b-4086-8f38-327d96ff0b6d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:20.102100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f276-ce48-49c2-ac76-4e66a513c647 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:20.134496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c40004-ef2e-4390-9a30-ae5aeb27ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:20.135444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c40004-ef2e-4390-9a30-ae5aeb27ae36 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:20.135789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c40004-ef2e-4390-9a30-ae5aeb27ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:20.135943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf6367-13e1-48df-b017-e847d9bed9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:20.136193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c40004-ef2e-4390-9a30-ae5aeb27ae36 None admin] PATH_INFO: `/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:20.136840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf6367-13e1-48df-b017-e847d9bed9de None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:20.137116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf6367-13e1-48df-b017-e847d9bed9de None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:20.137386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf6367-13e1-48df-b017-e847d9bed9de None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/e2e41b41f355446c8462fafcd91c183f/roles/a096f9f4b98445a0b52eb5d99eb757c1` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:20.137639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c40004-ef2e-4390-9a30-ae5aeb27ae36 None admin] RBAC: Authorizing `identity:get_project(project_id=1779fe9011ec4a88b8bb2a5183b24d3e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:20.139091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c40004-ef2e-4390-9a30-ae5aeb27ae36 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:20.139594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf6367-13e1-48df-b017-e847d9bed9de None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=e2e41b41f355446c8462fafcd91c183f, role_id=a096f9f4b98445a0b52eb5d99eb757c1)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:20.140902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 530/1079] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:47:20 2022] GET /identity/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:20.140993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf6367-13e1-48df-b017-e847d9bed9de None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:20.141676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c40004-ef2e-4390-9a30-ae5aeb27ae36 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:20.154280 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 550/1080] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:47:20 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/e2e41b41f355446c8462fafcd91c183f/roles/a096f9f4b98445a0b52eb5d99eb757c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:47:20.155043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf6367-13e1-48df-b017-e847d9bed9de None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:20.259716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf6367-13e1-48df-b017-e847d9bed9de None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:20.267418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c40004-ef2e-4390-9a30-ae5aeb27ae36 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:20.294520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca419e-1d71-42fe-9aa5-aa0aa39ccffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:20.295759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca419e-1d71-42fe-9aa5-aa0aa39ccffc None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:20.296036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca419e-1d71-42fe-9aa5-aa0aa39ccffc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:20.296297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca419e-1d71-42fe-9aa5-aa0aa39ccffc None admin] PATH_INFO: `/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e/users/a8523bd3d66e444d9873e3f001432ec2/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:20.298363 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca419e-1d71-42fe-9aa5-aa0aa39ccffc None admin] RBAC: Authorizing `identity:create_grant(project_id=1779fe9011ec4a88b8bb2a5183b24d3e, user_id=a8523bd3d66e444d9873e3f001432ec2, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:20.299810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca419e-1d71-42fe-9aa5-aa0aa39ccffc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:20.302317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd6c24-d02a-431b-b556-7d820fbed064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:20.303520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd6c24-d02a-431b-b556-7d820fbed064 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:20.304193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd6c24-d02a-431b-b556-7d820fbed064 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:20.304486 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd6c24-d02a-431b-b556-7d820fbed064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:20.315417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 551/1081] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:47:20 2022] PUT /identity/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e/users/a8523bd3d66e444d9873e3f001432ec2/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:47:20.389156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd6c24-d02a-431b-b556-7d820fbed064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:20.390696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd6c24-d02a-431b-b556-7d820fbed064 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:20.493375 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 531/1082] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:47:20.499173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca419e-1d71-42fe-9aa5-aa0aa39ccffc None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:20.601386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca419e-1d71-42fe-9aa5-aa0aa39ccffc None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:20.633878 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915555b-661d-4afb-b5b6-94fbd739f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:20.634787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915555b-661d-4afb-b5b6-94fbd739f6de None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:20.635072 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915555b-661d-4afb-b5b6-94fbd739f6de None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:20.635409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915555b-661d-4afb-b5b6-94fbd739f6de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:20.646225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915555b-661d-4afb-b5b6-94fbd739f6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:20.647734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915555b-661d-4afb-b5b6-94fbd739f6de None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-b915555b-661d-4afb-b5b6-94fbd739f6de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:20.665802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:20.666757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:20.667658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:20.667658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:20.667658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:20.667658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:20.667658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 552/1083] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:20.674138 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd6c24-d02a-431b-b556-7d820fbed064 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:20.768311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd6c24-d02a-431b-b556-7d820fbed064 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:20.801424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c774a-719e-4739-85c2-b72e39c1c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:20.802118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c774a-719e-4739-85c2-b72e39c1c176 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:20.802403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c774a-719e-4739-85c2-b72e39c1c176 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:20.803237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c774a-719e-4739-85c2-b72e39c1c176 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:20.803972 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c774a-719e-4739-85c2-b72e39c1c176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:20.804278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c774a-719e-4739-85c2-b72e39c1c176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:20.805664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c774a-719e-4739-85c2-b72e39c1c176 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:20.816863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 532/1084] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:22.377027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce099c-ab68-4cde-b5fb-044579f4cc37 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:22.377602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce099c-ab68-4cde-b5fb-044579f4cc37 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:22.377602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce099c-ab68-4cde-b5fb-044579f4cc37 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:22.378891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 553/1085] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:22.384891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c5d14-6011-4419-9305-20512be2f09a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:22.385401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c5d14-6011-4419-9305-20512be2f09a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:22.385489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c5d14-6011-4419-9305-20512be2f09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:22.402433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c99c5d14-6011-4419-9305-20512be2f09a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:22.403585 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c99c5d14-6011-4419-9305-20512be2f09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:22.466607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 533/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:22.490214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce099c-ab68-4cde-b5fb-044579f4cc37 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:22.544698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16735e51-678e-4ff8-97bb-7479952bf286 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:22.545236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16735e51-678e-4ff8-97bb-7479952bf286 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:22.545511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16735e51-678e-4ff8-97bb-7479952bf286 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:22.546898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 534/1087] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:47:22.551698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cb774-177f-48b5-94fb-251ccd65d262 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:22.551985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cb774-177f-48b5-94fb-251ccd65d262 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:22.552259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cb774-177f-48b5-94fb-251ccd65d262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:22.568183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e69cb774-177f-48b5-94fb-251ccd65d262 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:22.569342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e69cb774-177f-48b5-94fb-251ccd65d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:22.587483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce099c-ab68-4cde-b5fb-044579f4cc37 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:22.619903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4294c-cefe-4c63-890d-01e58ab1a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:22.620702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4294c-cefe-4c63-890d-01e58ab1a546 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:22.620980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4294c-cefe-4c63-890d-01e58ab1a546 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:22.621252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4294c-cefe-4c63-890d-01e58ab1a546 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:22.630970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4294c-cefe-4c63-890d-01e58ab1a546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:22.631937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 535/1088] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-b2e4294c-cefe-4c63-890d-01e58ab1a546 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:22.639088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:22.640074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:22.640936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 554/1089] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 12 18:47:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:22.645988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cb774-177f-48b5-94fb-251ccd65d262 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:22.655171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4294c-cefe-4c63-890d-01e58ab1a546 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:22.739308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cb774-177f-48b5-94fb-251ccd65d262 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:22.747753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4294c-cefe-4c63-890d-01e58ab1a546 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:22.771261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2a35-380d-4369-bb9f-8a42b2b40341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:22.772490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2a35-380d-4369-bb9f-8a42b2b40341 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:22.772777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2a35-380d-4369-bb9f-8a42b2b40341 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:22.773050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2a35-380d-4369-bb9f-8a42b2b40341 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:22.773961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d2a35-380d-4369-bb9f-8a42b2b40341 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:22.774271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d2a35-380d-4369-bb9f-8a42b2b40341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:22.775650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d2a35-380d-4369-bb9f-8a42b2b40341 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:22.779376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b684322-ecb7-4576-bea4-0fcba35130da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:22.780137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b684322-ecb7-4576-bea4-0fcba35130da None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:22.780412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b684322-ecb7-4576-bea4-0fcba35130da None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:22.780682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b684322-ecb7-4576-bea4-0fcba35130da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:22.783442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 536/1090] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 12 18:47:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:22.788982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2a35-380d-4369-bb9f-8a42b2b40341 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:22.790453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b684322-ecb7-4576-bea4-0fcba35130da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-3b684322-ecb7-4576-bea4-0fcba35130da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:22.798114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:22.799066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:22.799932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 555/1091] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:22.805012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b684322-ecb7-4576-bea4-0fcba35130da None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:22.881808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2a35-380d-4369-bb9f-8a42b2b40341 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:22.899220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b684322-ecb7-4576-bea4-0fcba35130da None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:22.913544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163936-351e-48b8-83c2-4211e4acfc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:22.914335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163936-351e-48b8-83c2-4211e4acfc80 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:22.914616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163936-351e-48b8-83c2-4211e4acfc80 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:22.914888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163936-351e-48b8-83c2-4211e4acfc80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:22.925228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc163936-351e-48b8-83c2-4211e4acfc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:22.926688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc163936-351e-48b8-83c2-4211e4acfc80 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:22.932537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350edb4-1eb7-497f-bb2c-7cfe6bc03f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:22.933190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350edb4-1eb7-497f-bb2c-7cfe6bc03f92 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:22.933473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350edb4-1eb7-497f-bb2c-7cfe6bc03f92 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:22.933778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350edb4-1eb7-497f-bb2c-7cfe6bc03f92 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:22.934512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350edb4-1eb7-497f-bb2c-7cfe6bc03f92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:22.934817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350edb4-1eb7-497f-bb2c-7cfe6bc03f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:22.936164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350edb4-1eb7-497f-bb2c-7cfe6bc03f92 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-dc163936-351e-48b8-83c2-4211e4acfc80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:22.943777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:22.944694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:22.945650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:22.945650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:22.945650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:22.945650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:22.945874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 556/1092] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:47:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:22.945952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 537/1093] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:22.950001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350edb4-1eb7-497f-bb2c-7cfe6bc03f92 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:22.950287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163936-351e-48b8-83c2-4211e4acfc80 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:23.042189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350edb4-1eb7-497f-bb2c-7cfe6bc03f92 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.043057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163936-351e-48b8-83c2-4211e4acfc80 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.074020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754a626-7667-47ab-90eb-85a9558e193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.074871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754a626-7667-47ab-90eb-85a9558e193c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.074979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29675372-84ad-4a86-80a3-09c43e56b9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.075150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754a626-7667-47ab-90eb-85a9558e193c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.075422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754a626-7667-47ab-90eb-85a9558e193c None admin] PATH_INFO: `/v3/users/a8523bd3d66e444d9873e3f001432ec2` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.075618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29675372-84ad-4a86-80a3-09c43e56b9a9 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.075957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29675372-84ad-4a86-80a3-09c43e56b9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.076180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29675372-84ad-4a86-80a3-09c43e56b9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.076591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754a626-7667-47ab-90eb-85a9558e193c None admin] RBAC: Authorizing `identity:get_user(user_id=a8523bd3d66e444d9873e3f001432ec2)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.076899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29675372-84ad-4a86-80a3-09c43e56b9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:23.077211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29675372-84ad-4a86-80a3-09c43e56b9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.078061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754a626-7667-47ab-90eb-85a9558e193c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:23.078661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29675372-84ad-4a86-80a3-09c43e56b9a9 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:23.079829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 557/1094] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:22 2022] GET /identity/v3/users/a8523bd3d66e444d9873e3f001432ec2 => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:23.085199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754a626-7667-47ab-90eb-85a9558e193c None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:23.090491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 538/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:23.095782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29675372-84ad-4a86-80a3-09c43e56b9a9 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:23.179422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754a626-7667-47ab-90eb-85a9558e193c None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.189787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29675372-84ad-4a86-80a3-09c43e56b9a9 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.211024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6872-0f90-4cef-923f-49d96ca9ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.211691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6872-0f90-4cef-923f-49d96ca9ae35 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.211968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6872-0f90-4cef-923f-49d96ca9ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.212239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6872-0f90-4cef-923f-49d96ca9ae35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.223254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82572555-b6ec-430e-b39b-1cb62c37679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.224037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82572555-b6ec-430e-b39b-1cb62c37679a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.224343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82572555-b6ec-430e-b39b-1cb62c37679a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.225149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82572555-b6ec-430e-b39b-1cb62c37679a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.231974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82572555-b6ec-430e-b39b-1cb62c37679a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.233401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82572555-b6ec-430e-b39b-1cb62c37679a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-82572555-b6ec-430e-b39b-1cb62c37679a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:47:23.247269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:23.248281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:23.249262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 539/1096] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 12 18:47:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:23.254048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82572555-b6ec-430e-b39b-1cb62c37679a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:23.275774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f6872-0f90-4cef-923f-49d96ca9ae35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.277210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f6872-0f90-4cef-923f-49d96ca9ae35 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:23.346148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82572555-b6ec-430e-b39b-1cb62c37679a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.369342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 558/1097] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 18:47:23.375120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6872-0f90-4cef-923f-49d96ca9ae35 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:23.378170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492265-cbce-4c54-b619-2f208aa5c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.378829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492265-cbce-4c54-b619-2f208aa5c117 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.379107 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492265-cbce-4c54-b619-2f208aa5c117 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.379377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492265-cbce-4c54-b619-2f208aa5c117 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.380198 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08492265-cbce-4c54-b619-2f208aa5c117 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:23.380498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08492265-cbce-4c54-b619-2f208aa5c117 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.381994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08492265-cbce-4c54-b619-2f208aa5c117 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:23.398924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 540/1098] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 12 18:47:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:23.404406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492265-cbce-4c54-b619-2f208aa5c117 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:23.466470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6872-0f90-4cef-923f-49d96ca9ae35 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.495080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492265-cbce-4c54-b619-2f208aa5c117 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.498086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9e685-1ac9-4d56-8043-74b62508930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.498916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9e685-1ac9-4d56-8043-74b62508930a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.499193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9e685-1ac9-4d56-8043-74b62508930a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.499465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9e685-1ac9-4d56-8043-74b62508930a None admin] PATH_INFO: `/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.500620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9e685-1ac9-4d56-8043-74b62508930a None admin] RBAC: Authorizing `identity:get_project(project_id=1779fe9011ec4a88b8bb2a5183b24d3e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.502074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9e685-1ac9-4d56-8043-74b62508930a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:23.509210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 559/1099] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:47:23 2022] GET /identity/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:23.510031 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9e685-1ac9-4d56-8043-74b62508930a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:23.527450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bbbde-60b0-41b2-a379-9eac207dc6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.528086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bbbde-60b0-41b2-a379-9eac207dc6b0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.528366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bbbde-60b0-41b2-a379-9eac207dc6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.528640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bbbde-60b0-41b2-a379-9eac207dc6b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.590868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bbbde-60b0-41b2-a379-9eac207dc6b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.592292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bbbde-60b0-41b2-a379-9eac207dc6b0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:23.602860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9e685-1ac9-4d56-8043-74b62508930a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.634437 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a894bd-1c46-4420-9591-679e48eeb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.635071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a894bd-1c46-4420-9591-679e48eeb24e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.635349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a894bd-1c46-4420-9591-679e48eeb24e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.635615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a894bd-1c46-4420-9591-679e48eeb24e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.636424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a894bd-1c46-4420-9591-679e48eeb24e None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=1779fe9011ec4a88b8bb2a5183b24d3e, user.id=a8523bd3d66e444d9873e3f001432ec2) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:23.636726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a894bd-1c46-4420-9591-679e48eeb24e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.638162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a894bd-1c46-4420-9591-679e48eeb24e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:23.643668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 560/1100] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:47:23 2022] GET /identity/v3/role_assignments?user.id=a8523bd3d66e444d9873e3f001432ec2&scope.project.id=1779fe9011ec4a88b8bb2a5183b24d3e&role.id=d03e020b3fb34446bbf5893b28904483 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:23.687880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 541/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 18:47:23.694219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a894bd-1c46-4420-9591-679e48eeb24e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:23.794582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a894bd-1c46-4420-9591-679e48eeb24e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.829152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b2302-c3d1-41f6-80d1-8ca1231f16a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.830084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b2302-c3d1-41f6-80d1-8ca1231f16a7 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.830359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b2302-c3d1-41f6-80d1-8ca1231f16a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.830629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b2302-c3d1-41f6-80d1-8ca1231f16a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.841312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b2302-c3d1-41f6-80d1-8ca1231f16a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.842802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b2302-c3d1-41f6-80d1-8ca1231f16a7 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-9a2b2302-c3d1-41f6-80d1-8ca1231f16a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:23.859857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:23.860826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:23.861790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:47:23.861790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:23.861790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:47:23.861790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:23.861790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 561/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:47:23.868275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bbbde-60b0-41b2-a379-9eac207dc6b0 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:23.963112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bbbde-60b0-41b2-a379-9eac207dc6b0 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:23.995408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1033d-f1ce-4521-a3fb-f24166303e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:23.996092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1033d-f1ce-4521-a3fb-f24166303e5d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:23.996359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1033d-f1ce-4521-a3fb-f24166303e5d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:23.996635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1033d-f1ce-4521-a3fb-f24166303e5d None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:23.997359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1033d-f1ce-4521-a3fb-f24166303e5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:23.997705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1033d-f1ce-4521-a3fb-f24166303e5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:23.999067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1033d-f1ce-4521-a3fb-f24166303e5d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:24.010382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 542/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:24.016026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b2302-c3d1-41f6-80d1-8ca1231f16a7 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:24.109975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b2302-c3d1-41f6-80d1-8ca1231f16a7 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:24.143077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e18ad-bcf4-49d7-80d7-a71e07b06e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:24.143858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e18ad-bcf4-49d7-80d7-a71e07b06e9b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:24.144138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e18ad-bcf4-49d7-80d7-a71e07b06e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:24.144412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e18ad-bcf4-49d7-80d7-a71e07b06e9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:24.150943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e18ad-bcf4-49d7-80d7-a71e07b06e9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:24.152377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e18ad-bcf4-49d7-80d7-a71e07b06e9b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-6d9e18ad-bcf4-49d7-80d7-a71e07b06e9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:47:24.165841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:24.166741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:24.167664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:47:24.167664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:47:24.167664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:47:24.167664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:47:24.167664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:47:24.167664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:47:24.167664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:47:24.167664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:24.167664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 562/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:24.173030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1033d-f1ce-4521-a3fb-f24166303e5d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:24.269685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1033d-f1ce-4521-a3fb-f24166303e5d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:24.301904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875382-644c-4fcc-a3cf-ed71f819f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:24.303102 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875382-644c-4fcc-a3cf-ed71f819f834 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:24.303388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875382-644c-4fcc-a3cf-ed71f819f834 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:24.303664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875382-644c-4fcc-a3cf-ed71f819f834 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:24.304439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875382-644c-4fcc-a3cf-ed71f819f834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:24.304745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875382-644c-4fcc-a3cf-ed71f819f834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:24.306196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875382-644c-4fcc-a3cf-ed71f819f834 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:24.317535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 543/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:24.323513 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e18ad-bcf4-49d7-80d7-a71e07b06e9b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:24.421576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e18ad-bcf4-49d7-80d7-a71e07b06e9b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:24.453027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f228a-365e-4938-95a9-e6249861c1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:24.453693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f228a-365e-4938-95a9-e6249861c1cc None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:24.453970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f228a-365e-4938-95a9-e6249861c1cc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:24.454239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f228a-365e-4938-95a9-e6249861c1cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:24.455052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f228a-365e-4938-95a9-e6249861c1cc None admin] RBAC: Adding query filter params (role.id=a096f9f4b98445a0b52eb5d99eb757c1, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=e2e41b41f355446c8462fafcd91c183f) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:24.455356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f228a-365e-4938-95a9-e6249861c1cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:24.456765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f228a-365e-4938-95a9-e6249861c1cc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:24.462523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 563/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:47:24 2022] GET /identity/v3/role_assignments?user.id=e2e41b41f355446c8462fafcd91c183f&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=a096f9f4b98445a0b52eb5d99eb757c1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:25.883062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa93d7-f746-49f9-9794-fcefca8c8959 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:25.883601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa93d7-f746-49f9-9794-fcefca8c8959 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:25.883601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa93d7-f746-49f9-9794-fcefca8c8959 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:25.884987 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 544/1107] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:25.890444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334473a-5e5a-46c3-954c-1c77ee263503 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:25.890846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334473a-5e5a-46c3-954c-1c77ee263503 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:25.891002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334473a-5e5a-46c3-954c-1c77ee263503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:25.908349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d334473a-5e5a-46c3-954c-1c77ee263503 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:25.909552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d334473a-5e5a-46c3-954c-1c77ee263503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:25.972667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 564/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:25.997786 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa93d7-f746-49f9-9794-fcefca8c8959 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:26.092310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa93d7-f746-49f9-9794-fcefca8c8959 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:26.124502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be8f7f-f1ae-46bc-af1d-22fec4a3ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:26.125279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8f7f-f1ae-46bc-af1d-22fec4a3ca0f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:26.125588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8f7f-f1ae-46bc-af1d-22fec4a3ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:26.125866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8f7f-f1ae-46bc-af1d-22fec4a3ca0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:26.127521 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be8f7f-f1ae-46bc-af1d-22fec4a3ca0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:26.128441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be8f7f-f1ae-46bc-af1d-22fec4a3ca0f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:26.130075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 545/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:26.135888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334473a-5e5a-46c3-954c-1c77ee263503 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:26.228844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334473a-5e5a-46c3-954c-1c77ee263503 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:26.260755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20a65f-0d60-4f1f-8e4c-8e1c4b789b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:26.261403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20a65f-0d60-4f1f-8e4c-8e1c4b789b1d None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:26.261716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20a65f-0d60-4f1f-8e4c-8e1c4b789b1d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:26.261993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20a65f-0d60-4f1f-8e4c-8e1c4b789b1d None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:26.262687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20a65f-0d60-4f1f-8e4c-8e1c4b789b1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:26.264102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20a65f-0d60-4f1f-8e4c-8e1c4b789b1d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:26.283501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 565/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:47:26 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:28.533164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332e98-0ddc-4a0d-b378-2cd99b6640a3 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:28.533777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332e98-0ddc-4a0d-b378-2cd99b6640a3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:28.533777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332e98-0ddc-4a0d-b378-2cd99b6640a3 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:28.535104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 546/1111] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:28.540413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6151c3-8617-4a70-b166-edbc05e6d197 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:28.540852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6151c3-8617-4a70-b166-edbc05e6d197 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:28.540950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6151c3-8617-4a70-b166-edbc05e6d197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:28.557725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1e6151c3-8617-4a70-b166-edbc05e6d197 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:28.558879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1e6151c3-8617-4a70-b166-edbc05e6d197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:28.620732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 566/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:28.644006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58332e98-0ddc-4a0d-b378-2cd99b6640a3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:28.745197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58332e98-0ddc-4a0d-b378-2cd99b6640a3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:28.776732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd692c-7ee6-4f83-bb82-5da4d2c35f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:28.777595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd692c-7ee6-4f83-bb82-5da4d2c35f3d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:28.777880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd692c-7ee6-4f83-bb82-5da4d2c35f3d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:28.778151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd692c-7ee6-4f83-bb82-5da4d2c35f3d None admin] PATH_INFO: `/v3/roles/ee5d57f7c4704b3d907933236c98c2c2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:28.779596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd692c-7ee6-4f83-bb82-5da4d2c35f3d None admin] RBAC: Authorizing `identity:get_role(role_id=ee5d57f7c4704b3d907933236c98c2c2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:28.780946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd692c-7ee6-4f83-bb82-5da4d2c35f3d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:28.782329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 547/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:28 2022] GET /identity/v3/roles/ee5d57f7c4704b3d907933236c98c2c2 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:28.788559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6151c3-8617-4a70-b166-edbc05e6d197 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:28.879953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6151c3-8617-4a70-b166-edbc05e6d197 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:28.910581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf6a52-aa94-451d-bc53-d8e4c8165f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:28.911414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf6a52-aa94-451d-bc53-d8e4c8165f24 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:28.912201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf6a52-aa94-451d-bc53-d8e4c8165f24 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:28.912469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf6a52-aa94-451d-bc53-d8e4c8165f24 None admin] PATH_INFO: `/v3/users/b805cbcf548840e89772752a3cc93c10` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:28.925533 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf6a52-aa94-451d-bc53-d8e4c8165f24 None admin] RBAC: Authorizing `identity:get_user(user_id=b805cbcf548840e89772752a3cc93c10)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:28.927004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf6a52-aa94-451d-bc53-d8e4c8165f24 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:28.929328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 567/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:28 2022] GET /identity/v3/users/b805cbcf548840e89772752a3cc93c10 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:28.934905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd692c-7ee6-4f83-bb82-5da4d2c35f3d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:29.030522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd692c-7ee6-4f83-bb82-5da4d2c35f3d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:29.063464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6110be-6a1d-4258-9917-685af0c4c0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:29.064041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6110be-6a1d-4258-9917-685af0c4c0d1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:29.064327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6110be-6a1d-4258-9917-685af0c4c0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:29.064604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6110be-6a1d-4258-9917-685af0c4c0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:29.127467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6110be-6a1d-4258-9917-685af0c4c0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:29.128509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6110be-6a1d-4258-9917-685af0c4c0d1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:29.220298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 548/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:47:29.226782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf6a52-aa94-451d-bc53-d8e4c8165f24 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:29.319864 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf6a52-aa94-451d-bc53-d8e4c8165f24 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:29.352076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f86a8-4515-4cf7-8507-fbeb8ffe7e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:29.352905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f86a8-4515-4cf7-8507-fbeb8ffe7e01 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:29.353186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f86a8-4515-4cf7-8507-fbeb8ffe7e01 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:29.353462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f86a8-4515-4cf7-8507-fbeb8ffe7e01 None admin] PATH_INFO: `/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:29.354652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f86a8-4515-4cf7-8507-fbeb8ffe7e01 None admin] RBAC: Authorizing `identity:get_project(project_id=1779fe9011ec4a88b8bb2a5183b24d3e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:29.356065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f86a8-4515-4cf7-8507-fbeb8ffe7e01 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:29.357760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 568/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:47:29 2022] GET /identity/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:29.363709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6110be-6a1d-4258-9917-685af0c4c0d1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:29.461997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6110be-6a1d-4258-9917-685af0c4c0d1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:29.493887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d49fe7-e4e8-427c-84a6-e3fcb67cd34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:29.494524 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d49fe7-e4e8-427c-84a6-e3fcb67cd34f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:29.494808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d49fe7-e4e8-427c-84a6-e3fcb67cd34f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:29.495083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d49fe7-e4e8-427c-84a6-e3fcb67cd34f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:29.495903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d49fe7-e4e8-427c-84a6-e3fcb67cd34f None admin] RBAC: Adding query filter params (role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=1779fe9011ec4a88b8bb2a5183b24d3e, user.id=b805cbcf548840e89772752a3cc93c10) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:29.496214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d49fe7-e4e8-427c-84a6-e3fcb67cd34f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:29.497655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d49fe7-e4e8-427c-84a6-e3fcb67cd34f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:29.502834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 549/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:47:29 2022] GET /identity/v3/role_assignments?user.id=b805cbcf548840e89772752a3cc93c10&scope.project.id=1779fe9011ec4a88b8bb2a5183b24d3e&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:31.659418 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b917-0bb5-49a6-a9bf-fada0516bc56 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:31.659974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b917-0bb5-49a6-a9bf-fada0516bc56 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:31.659974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b917-0bb5-49a6-a9bf-fada0516bc56 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:31.661333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 569/1118] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:31.667140 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a178e3-8560-4884-be16-f591f482c097 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:31.667558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a178e3-8560-4884-be16-f591f482c097 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:31.667692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a178e3-8560-4884-be16-f591f482c097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:31.683993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b0a178e3-8560-4884-be16-f591f482c097 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:31.685164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b0a178e3-8560-4884-be16-f591f482c097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:31.747172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 550/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:31.769569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5b917-0bb5-49a6-a9bf-fada0516bc56 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:31.864216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5b917-0bb5-49a6-a9bf-fada0516bc56 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:31.895774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd969bc-1873-4b31-8761-39539a6a5b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:31.896585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd969bc-1873-4b31-8761-39539a6a5b87 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:31.896864 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd969bc-1873-4b31-8761-39539a6a5b87 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:31.897135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd969bc-1873-4b31-8761-39539a6a5b87 None admin] PATH_INFO: `/v3/roles/ee5d57f7c4704b3d907933236c98c2c2` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:31.898613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd969bc-1873-4b31-8761-39539a6a5b87 None admin] RBAC: Authorizing `identity:get_role(role_id=ee5d57f7c4704b3d907933236c98c2c2)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:31.899972 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd969bc-1873-4b31-8761-39539a6a5b87 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:31.901300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 570/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:31 2022] GET /identity/v3/roles/ee5d57f7c4704b3d907933236c98c2c2 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:31.907021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a178e3-8560-4884-be16-f591f482c097 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:31.999570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a178e3-8560-4884-be16-f591f482c097 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:32.030816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dd416-8c70-4fa8-8e1c-739eba44b140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:32.031690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dd416-8c70-4fa8-8e1c-739eba44b140 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:32.031970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dd416-8c70-4fa8-8e1c-739eba44b140 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:32.032244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dd416-8c70-4fa8-8e1c-739eba44b140 None admin] PATH_INFO: `/v3/users/b805cbcf548840e89772752a3cc93c10` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:32.033407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dd416-8c70-4fa8-8e1c-739eba44b140 None admin] RBAC: Authorizing `identity:get_user(user_id=b805cbcf548840e89772752a3cc93c10)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:32.034853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dd416-8c70-4fa8-8e1c-739eba44b140 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:32.036985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 551/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:31 2022] GET /identity/v3/users/b805cbcf548840e89772752a3cc93c10 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:32.042702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd969bc-1873-4b31-8761-39539a6a5b87 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:32.134786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd969bc-1873-4b31-8761-39539a6a5b87 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:32.166677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285c9f9-72fc-4c25-a064-359b47e72b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:32.167508 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285c9f9-72fc-4c25-a064-359b47e72b70 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:32.167784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285c9f9-72fc-4c25-a064-359b47e72b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:32.168052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285c9f9-72fc-4c25-a064-359b47e72b70 None admin] PATH_INFO: `/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:32.169200 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285c9f9-72fc-4c25-a064-359b47e72b70 None admin] RBAC: Authorizing `identity:get_project(project_id=1779fe9011ec4a88b8bb2a5183b24d3e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:32.170918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285c9f9-72fc-4c25-a064-359b47e72b70 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:32.172562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 571/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:47:32 2022] GET /identity/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:32.178290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dd416-8c70-4fa8-8e1c-739eba44b140 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:32.270322 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dd416-8c70-4fa8-8e1c-739eba44b140 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:32.302620 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b46b4-0175-403e-8c72-15f24f4e973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:32.303467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b46b4-0175-403e-8c72-15f24f4e973e None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:32.303749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b46b4-0175-403e-8c72-15f24f4e973e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:32.304026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b46b4-0175-403e-8c72-15f24f4e973e None admin] PATH_INFO: `/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e/users/b805cbcf548840e89772752a3cc93c10/roles/ee5d57f7c4704b3d907933236c98c2c2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:32.306206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b46b4-0175-403e-8c72-15f24f4e973e None admin] RBAC: Authorizing `identity:create_grant(project_id=1779fe9011ec4a88b8bb2a5183b24d3e, user_id=b805cbcf548840e89772752a3cc93c10, role_id=ee5d57f7c4704b3d907933236c98c2c2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:32.307608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b46b4-0175-403e-8c72-15f24f4e973e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:32.319458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 552/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:47:32 2022] PUT /identity/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e/users/b805cbcf548840e89772752a3cc93c10/roles/ee5d57f7c4704b3d907933236c98c2c2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:47:34.487694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e628a9-94d0-4a67-93f3-010010345915 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:34.488238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e628a9-94d0-4a67-93f3-010010345915 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:34.488238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e628a9-94d0-4a67-93f3-010010345915 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:34.490154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 572/1124] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:34.495367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5436-a595-460d-9dde-3a6913cc411e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:34.495810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5436-a595-460d-9dde-3a6913cc411e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:34.495904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5436-a595-460d-9dde-3a6913cc411e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:34.522561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-515a5436-a595-460d-9dde-3a6913cc411e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:34.523756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-515a5436-a595-460d-9dde-3a6913cc411e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:34.586271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 553/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:34.610116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e628a9-94d0-4a67-93f3-010010345915 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:34.710458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e628a9-94d0-4a67-93f3-010010345915 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:34.743765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2f10f-076e-4ef6-b4ff-fdb7d7b16823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:34.744528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2f10f-076e-4ef6-b4ff-fdb7d7b16823 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:34.744802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2f10f-076e-4ef6-b4ff-fdb7d7b16823 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:34.745071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2f10f-076e-4ef6-b4ff-fdb7d7b16823 None admin] PATH_INFO: `/v3/roles/ee5d57f7c4704b3d907933236c98c2c2` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:34.746520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2f10f-076e-4ef6-b4ff-fdb7d7b16823 None admin] RBAC: Authorizing `identity:get_role(role_id=ee5d57f7c4704b3d907933236c98c2c2)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:34.747867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2f10f-076e-4ef6-b4ff-fdb7d7b16823 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:34.749214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 573/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:34 2022] GET /identity/v3/roles/ee5d57f7c4704b3d907933236c98c2c2 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:34.755614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5436-a595-460d-9dde-3a6913cc411e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:34.845509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5436-a595-460d-9dde-3a6913cc411e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:34.877115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e10640-3c28-47be-9462-0dfed1b6e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:34.877994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e10640-3c28-47be-9462-0dfed1b6e053 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:34.878273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e10640-3c28-47be-9462-0dfed1b6e053 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:34.878543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e10640-3c28-47be-9462-0dfed1b6e053 None admin] PATH_INFO: `/v3/users/b805cbcf548840e89772752a3cc93c10` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:34.879696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e10640-3c28-47be-9462-0dfed1b6e053 None admin] RBAC: Authorizing `identity:get_user(user_id=b805cbcf548840e89772752a3cc93c10)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:34.881661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e10640-3c28-47be-9462-0dfed1b6e053 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:34.883227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 554/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:34 2022] GET /identity/v3/users/b805cbcf548840e89772752a3cc93c10 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:34.888702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2f10f-076e-4ef6-b4ff-fdb7d7b16823 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:34.980557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2f10f-076e-4ef6-b4ff-fdb7d7b16823 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:35.012867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cb764-7c3c-45cc-b7f5-0ccb9d8dac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:35.013470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cb764-7c3c-45cc-b7f5-0ccb9d8dac87 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:35.013773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cb764-7c3c-45cc-b7f5-0ccb9d8dac87 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:35.014040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cb764-7c3c-45cc-b7f5-0ccb9d8dac87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:35.082864 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cb764-7c3c-45cc-b7f5-0ccb9d8dac87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:35.084858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cb764-7c3c-45cc-b7f5-0ccb9d8dac87 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:35.175250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 574/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:47:35.181565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e10640-3c28-47be-9462-0dfed1b6e053 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:35.274572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e10640-3c28-47be-9462-0dfed1b6e053 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:35.305725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3b7a5-6cc5-4610-a82b-f23b5e3ac6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:35.306555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3b7a5-6cc5-4610-a82b-f23b5e3ac6f2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:35.306833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3b7a5-6cc5-4610-a82b-f23b5e3ac6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:35.307104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3b7a5-6cc5-4610-a82b-f23b5e3ac6f2 None admin] PATH_INFO: `/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:35.308254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3b7a5-6cc5-4610-a82b-f23b5e3ac6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=1779fe9011ec4a88b8bb2a5183b24d3e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:35.309704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3b7a5-6cc5-4610-a82b-f23b5e3ac6f2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:35.311355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 555/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:47:35 2022] GET /identity/v3/projects/1779fe9011ec4a88b8bb2a5183b24d3e => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:35.317165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cb764-7c3c-45cc-b7f5-0ccb9d8dac87 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:35.409012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cb764-7c3c-45cc-b7f5-0ccb9d8dac87 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:35.440772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90300172-080f-4e21-9a21-161248f9f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:35.441400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90300172-080f-4e21-9a21-161248f9f5e5 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:35.441710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90300172-080f-4e21-9a21-161248f9f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:35.441985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90300172-080f-4e21-9a21-161248f9f5e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:35.442799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90300172-080f-4e21-9a21-161248f9f5e5 None admin] RBAC: Adding query filter params (role.id=ee5d57f7c4704b3d907933236c98c2c2, scope.project.id=1779fe9011ec4a88b8bb2a5183b24d3e, user.id=b805cbcf548840e89772752a3cc93c10) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:35.443108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90300172-080f-4e21-9a21-161248f9f5e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:35.445181 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90300172-080f-4e21-9a21-161248f9f5e5 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:35.450736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 575/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:47:35 2022] GET /identity/v3/role_assignments?user.id=b805cbcf548840e89772752a3cc93c10&scope.project.id=1779fe9011ec4a88b8bb2a5183b24d3e&role.id=ee5d57f7c4704b3d907933236c98c2c2 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:37.657702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c639-5492-439e-959d-fef19269c47c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:37.658254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c639-5492-439e-959d-fef19269c47c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:37.658254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c639-5492-439e-959d-fef19269c47c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:37.659608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 556/1131] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:37.665300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c71e0-5db2-4300-b281-47fd303e22fa None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:37.665708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c71e0-5db2-4300-b281-47fd303e22fa None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:37.665883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c71e0-5db2-4300-b281-47fd303e22fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:37.682584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f38c71e0-5db2-4300-b281-47fd303e22fa None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:37.683747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f38c71e0-5db2-4300-b281-47fd303e22fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:37.745843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 576/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:37.769223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c639-5492-439e-959d-fef19269c47c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:37.871980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c639-5492-439e-959d-fef19269c47c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:37.904112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eb09a-aaf5-4804-b3fa-b2979976d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:37.904884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eb09a-aaf5-4804-b3fa-b2979976d67d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:37.905165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eb09a-aaf5-4804-b3fa-b2979976d67d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:37.905439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eb09a-aaf5-4804-b3fa-b2979976d67d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:37.906623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eb09a-aaf5-4804-b3fa-b2979976d67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:37.908081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eb09a-aaf5-4804-b3fa-b2979976d67d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:37.909628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 557/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:37.915426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c71e0-5db2-4300-b281-47fd303e22fa None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:38.007917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c71e0-5db2-4300-b281-47fd303e22fa None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:38.040321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a574-6a5b-400a-b82a-73c49970d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:38.040959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a574-6a5b-400a-b82a-73c49970d2e9 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:38.041238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a574-6a5b-400a-b82a-73c49970d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:38.041511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a574-6a5b-400a-b82a-73c49970d2e9 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:38.042225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013a574-6a5b-400a-b82a-73c49970d2e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:38.043643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013a574-6a5b-400a-b82a-73c49970d2e9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:38.067793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 577/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:47:37 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:40.293134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff6ee9-bddb-4a0c-a79e-3fd96af5cf6f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:40.293780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff6ee9-bddb-4a0c-a79e-3fd96af5cf6f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:40.293780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff6ee9-bddb-4a0c-a79e-3fd96af5cf6f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:40.295336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 558/1135] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:40.300617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b863-1a29-4f43-9573-a1d5eee0e86b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:40.300987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b863-1a29-4f43-9573-a1d5eee0e86b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:40.301172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b863-1a29-4f43-9573-a1d5eee0e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:40.318036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2f79b863-1a29-4f43-9573-a1d5eee0e86b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:40.319212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2f79b863-1a29-4f43-9573-a1d5eee0e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:40.381970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 578/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:40.406855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff6ee9-bddb-4a0c-a79e-3fd96af5cf6f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:40.500269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff6ee9-bddb-4a0c-a79e-3fd96af5cf6f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:40.531523 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f29e6-b4f3-47bd-a5de-12622f76c35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:40.532286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f29e6-b4f3-47bd-a5de-12622f76c35f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:40.532567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f29e6-b4f3-47bd-a5de-12622f76c35f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:40.532839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f29e6-b4f3-47bd-a5de-12622f76c35f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:40.534010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f29e6-b4f3-47bd-a5de-12622f76c35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:40.535423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f29e6-b4f3-47bd-a5de-12622f76c35f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:40.536986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 559/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:47:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:40.543059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79b863-1a29-4f43-9573-a1d5eee0e86b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:40.638210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79b863-1a29-4f43-9573-a1d5eee0e86b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:40.669731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96dd33-aa61-445d-821e-cefcda7dd900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:40.670929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96dd33-aa61-445d-821e-cefcda7dd900 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:40.671204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96dd33-aa61-445d-821e-cefcda7dd900 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:40.671478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96dd33-aa61-445d-821e-cefcda7dd900 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:40.672179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96dd33-aa61-445d-821e-cefcda7dd900 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:40.673608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96dd33-aa61-445d-821e-cefcda7dd900 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:40.692208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 579/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:47:40 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:42.928273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a6320-e9d5-4c7c-b061-63c5a12d6087 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:42.928866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a6320-e9d5-4c7c-b061-63c5a12d6087 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:42.928866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a6320-e9d5-4c7c-b061-63c5a12d6087 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:42.930237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 560/1139] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:42.935476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc474d58-168c-4d8a-a685-8573249a9d00 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:42.935894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc474d58-168c-4d8a-a685-8573249a9d00 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:42.936034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc474d58-168c-4d8a-a685-8573249a9d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:42.952751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-dc474d58-168c-4d8a-a685-8573249a9d00 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:42.953965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-dc474d58-168c-4d8a-a685-8573249a9d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:43.017297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 580/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:43.041712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a6320-e9d5-4c7c-b061-63c5a12d6087 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:43.137104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a6320-e9d5-4c7c-b061-63c5a12d6087 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:43.169897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e317744-f1c1-45d7-a69d-3f4923e63437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:43.170678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e317744-f1c1-45d7-a69d-3f4923e63437 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:43.170955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e317744-f1c1-45d7-a69d-3f4923e63437 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:43.171225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e317744-f1c1-45d7-a69d-3f4923e63437 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:43.180900 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e317744-f1c1-45d7-a69d-3f4923e63437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-0e317744-f1c1-45d7-a69d-3f4923e63437 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:43.188398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:43.189598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:43.190710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 561/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:47:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:43.195954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc474d58-168c-4d8a-a685-8573249a9d00 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:43.288448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc474d58-168c-4d8a-a685-8573249a9d00 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:43.320192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f31d1-fe20-406c-8b4a-07c9767cc651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:43.320835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f31d1-fe20-406c-8b4a-07c9767cc651 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:43.321117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f31d1-fe20-406c-8b4a-07c9767cc651 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:43.321390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f31d1-fe20-406c-8b4a-07c9767cc651 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:43.322149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f31d1-fe20-406c-8b4a-07c9767cc651 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:43.322455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f31d1-fe20-406c-8b4a-07c9767cc651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:43.323807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f31d1-fe20-406c-8b4a-07c9767cc651 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:43.331414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 581/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:47:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:43.337744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e317744-f1c1-45d7-a69d-3f4923e63437 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:43.431333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e317744-f1c1-45d7-a69d-3f4923e63437 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:43.462616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0b27e-652c-4435-bfdd-b5e0dc63ff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:43.463459 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0b27e-652c-4435-bfdd-b5e0dc63ff8d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:43.463742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0b27e-652c-4435-bfdd-b5e0dc63ff8d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:43.464015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0b27e-652c-4435-bfdd-b5e0dc63ff8d None admin] PATH_INFO: `/v3/users/6c1cae681a34468a90e5ef49d84ed934` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:43.476529 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0b27e-652c-4435-bfdd-b5e0dc63ff8d None admin] RBAC: Authorizing `identity:get_user(user_id=6c1cae681a34468a90e5ef49d84ed934)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:43.477997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0b27e-652c-4435-bfdd-b5e0dc63ff8d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:43.479607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 562/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:43 2022] GET /identity/v3/users/6c1cae681a34468a90e5ef49d84ed934 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:43.485040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f31d1-fe20-406c-8b4a-07c9767cc651 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:43.579425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f31d1-fe20-406c-8b4a-07c9767cc651 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:43.611176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c5449-e0f4-4f2d-8783-49253649c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:43.611810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c5449-e0f4-4f2d-8783-49253649c946 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:43.612093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c5449-e0f4-4f2d-8783-49253649c946 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:43.612369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c5449-e0f4-4f2d-8783-49253649c946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:43.675141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c5449-e0f4-4f2d-8783-49253649c946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:43.676594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c5449-e0f4-4f2d-8783-49253649c946 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:43.768684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 582/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:47:43.774348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0b27e-652c-4435-bfdd-b5e0dc63ff8d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:43.870129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0b27e-652c-4435-bfdd-b5e0dc63ff8d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:43.901285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d1219-5832-46a2-9914-417df840664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:43.902159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d1219-5832-46a2-9914-417df840664e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:43.902444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d1219-5832-46a2-9914-417df840664e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:43.902716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d1219-5832-46a2-9914-417df840664e None admin] PATH_INFO: `/v3/projects/afe85a9f336f4d0ebc105f6ef1e802da` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:43.903889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d1219-5832-46a2-9914-417df840664e None admin] RBAC: Authorizing `identity:get_project(project_id=afe85a9f336f4d0ebc105f6ef1e802da)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:43.905319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d1219-5832-46a2-9914-417df840664e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:43.907025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 563/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:47:43 2022] GET /identity/v3/projects/afe85a9f336f4d0ebc105f6ef1e802da => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:43.913656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c5449-e0f4-4f2d-8783-49253649c946 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:44.006530 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c5449-e0f4-4f2d-8783-49253649c946 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:44.038614 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14690878-0237-4d92-b384-45619e1fd320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:44.040146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14690878-0237-4d92-b384-45619e1fd320 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:44.040426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14690878-0237-4d92-b384-45619e1fd320 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:44.040706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14690878-0237-4d92-b384-45619e1fd320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:44.041568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14690878-0237-4d92-b384-45619e1fd320 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=afe85a9f336f4d0ebc105f6ef1e802da, user.id=6c1cae681a34468a90e5ef49d84ed934) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:44.041863 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14690878-0237-4d92-b384-45619e1fd320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:44.043302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14690878-0237-4d92-b384-45619e1fd320 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:44.049720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 583/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:47:43 2022] GET /identity/v3/role_assignments?user.id=6c1cae681a34468a90e5ef49d84ed934&scope.project.id=afe85a9f336f4d0ebc105f6ef1e802da&role.id=d03e020b3fb34446bbf5893b28904483 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:46.214316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7642b-5bb8-4336-a7a1-d5b3b78c6c4e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:46.214862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7642b-5bb8-4336-a7a1-d5b3b78c6c4e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:46.214862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7642b-5bb8-4336-a7a1-d5b3b78c6c4e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:46.216220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 564/1147] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:46.221369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8126f9b-fe23-4443-8ee3-9df8c3856158 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:46.221829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8126f9b-fe23-4443-8ee3-9df8c3856158 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:46.221936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8126f9b-fe23-4443-8ee3-9df8c3856158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:46.237911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d8126f9b-fe23-4443-8ee3-9df8c3856158 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:46.239057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d8126f9b-fe23-4443-8ee3-9df8c3856158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:46.300372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 584/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:46.323009 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7642b-5bb8-4336-a7a1-d5b3b78c6c4e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:46.416726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7642b-5bb8-4336-a7a1-d5b3b78c6c4e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:46.448693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6094-0808-4083-8730-e508b8f9a141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:46.449458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6094-0808-4083-8730-e508b8f9a141 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:46.449768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6094-0808-4083-8730-e508b8f9a141 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:46.450043 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6094-0808-4083-8730-e508b8f9a141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:46.459519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba6094-0808-4083-8730-e508b8f9a141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-35ba6094-0808-4083-8730-e508b8f9a141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:46.467070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:46.468154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:46.469174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 565/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:47:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:46.473902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8126f9b-fe23-4443-8ee3-9df8c3856158 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:46.564867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8126f9b-fe23-4443-8ee3-9df8c3856158 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:46.596126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbb163-0fc1-4af2-977a-77facffceab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:46.596970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbb163-0fc1-4af2-977a-77facffceab2 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:46.597285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbb163-0fc1-4af2-977a-77facffceab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:46.597707 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbb163-0fc1-4af2-977a-77facffceab2 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:46.598636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbb163-0fc1-4af2-977a-77facffceab2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:46.598997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbb163-0fc1-4af2-977a-77facffceab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:46.600474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbb163-0fc1-4af2-977a-77facffceab2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:46.608168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 585/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:47:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:46.613945 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6094-0808-4083-8730-e508b8f9a141 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:46.714443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6094-0808-4083-8730-e508b8f9a141 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:46.745889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b6db-3764-469a-ba22-b79ce2f6d883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:46.746738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b6db-3764-469a-ba22-b79ce2f6d883 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:46.747015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b6db-3764-469a-ba22-b79ce2f6d883 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:46.747286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b6db-3764-469a-ba22-b79ce2f6d883 None admin] PATH_INFO: `/v3/users/6c1cae681a34468a90e5ef49d84ed934` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:46.748468 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8b6db-3764-469a-ba22-b79ce2f6d883 None admin] RBAC: Authorizing `identity:get_user(user_id=6c1cae681a34468a90e5ef49d84ed934)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:46.749913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8b6db-3764-469a-ba22-b79ce2f6d883 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:46.751498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 566/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:46 2022] GET /identity/v3/users/6c1cae681a34468a90e5ef49d84ed934 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:46.757345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbb163-0fc1-4af2-977a-77facffceab2 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:46.850083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbb163-0fc1-4af2-977a-77facffceab2 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:46.881424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a585a-c83b-4dd3-b340-3861ea04799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:46.882317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a585a-c83b-4dd3-b340-3861ea04799a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:46.882593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a585a-c83b-4dd3-b340-3861ea04799a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:46.882862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a585a-c83b-4dd3-b340-3861ea04799a None admin] PATH_INFO: `/v3/projects/afe85a9f336f4d0ebc105f6ef1e802da` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:46.883994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a585a-c83b-4dd3-b340-3861ea04799a None admin] RBAC: Authorizing `identity:get_project(project_id=afe85a9f336f4d0ebc105f6ef1e802da)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:46.885395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a585a-c83b-4dd3-b340-3861ea04799a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:46.887128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 586/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:47:46 2022] GET /identity/v3/projects/afe85a9f336f4d0ebc105f6ef1e802da => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:46.892695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b6db-3764-469a-ba22-b79ce2f6d883 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:46.985280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b6db-3764-469a-ba22-b79ce2f6d883 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:47.016128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0937f-7a37-450c-aa08-deda25bb2dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:47.016979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0937f-7a37-450c-aa08-deda25bb2dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:47.017257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0937f-7a37-450c-aa08-deda25bb2dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:47.017556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0937f-7a37-450c-aa08-deda25bb2dc5 None admin] PATH_INFO: `/v3/projects/afe85a9f336f4d0ebc105f6ef1e802da/users/6c1cae681a34468a90e5ef49d84ed934/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:47.019452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0937f-7a37-450c-aa08-deda25bb2dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=afe85a9f336f4d0ebc105f6ef1e802da, user_id=6c1cae681a34468a90e5ef49d84ed934, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:47.020845 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0937f-7a37-450c-aa08-deda25bb2dc5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:47.032989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 567/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:47:46 2022] PUT /identity/v3/projects/afe85a9f336f4d0ebc105f6ef1e802da/users/6c1cae681a34468a90e5ef49d84ed934/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:47:49.210934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bce98-6647-49d3-9e7f-4e22bb20edec None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:49.211432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bce98-6647-49d3-9e7f-4e22bb20edec None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:49.211540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bce98-6647-49d3-9e7f-4e22bb20edec None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:49.212821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 587/1154] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:49.218031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc5358-d40f-4f9a-aeaf-3ba7feef4a76 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:49.218453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc5358-d40f-4f9a-aeaf-3ba7feef4a76 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:49.218595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc5358-d40f-4f9a-aeaf-3ba7feef4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:49.237929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c7cc5358-d40f-4f9a-aeaf-3ba7feef4a76 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:49.239125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c7cc5358-d40f-4f9a-aeaf-3ba7feef4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:49.301883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 568/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:49.325360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bce98-6647-49d3-9e7f-4e22bb20edec None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:49.420119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bce98-6647-49d3-9e7f-4e22bb20edec None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:49.451529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c6c96-9d94-4bab-8999-1f9a18d2a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:49.452288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6c96-9d94-4bab-8999-1f9a18d2a888 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:49.452566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6c96-9d94-4bab-8999-1f9a18d2a888 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:49.452838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6c96-9d94-4bab-8999-1f9a18d2a888 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:49.463431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c6c96-9d94-4bab-8999-1f9a18d2a888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-a28c6c96-9d94-4bab-8999-1f9a18d2a888 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:47:49.470790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:49.471872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:47:49.473049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 588/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:49.477747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc5358-d40f-4f9a-aeaf-3ba7feef4a76 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:49.571008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc5358-d40f-4f9a-aeaf-3ba7feef4a76 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:49.603029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee668-3fd9-41f0-b241-da93b4994e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:49.603679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee668-3fd9-41f0-b241-da93b4994e54 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:49.603963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee668-3fd9-41f0-b241-da93b4994e54 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:49.604240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee668-3fd9-41f0-b241-da93b4994e54 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:49.604983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee668-3fd9-41f0-b241-da93b4994e54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:49.605287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee668-3fd9-41f0-b241-da93b4994e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:49.606667 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee668-3fd9-41f0-b241-da93b4994e54 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:49.614488 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 569/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:49.620589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c6c96-9d94-4bab-8999-1f9a18d2a888 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:49.713353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c6c96-9d94-4bab-8999-1f9a18d2a888 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:49.745020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b162f6-febd-4bcf-b6bc-ecc621ec3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:49.745870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b162f6-febd-4bcf-b6bc-ecc621ec3282 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:49.746143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b162f6-febd-4bcf-b6bc-ecc621ec3282 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:49.746407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b162f6-febd-4bcf-b6bc-ecc621ec3282 None admin] PATH_INFO: `/v3/users/6c1cae681a34468a90e5ef49d84ed934` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:49.747547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b162f6-febd-4bcf-b6bc-ecc621ec3282 None admin] RBAC: Authorizing `identity:get_user(user_id=6c1cae681a34468a90e5ef49d84ed934)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:49.749000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b162f6-febd-4bcf-b6bc-ecc621ec3282 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:49.750582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 589/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:47:49 2022] GET /identity/v3/users/6c1cae681a34468a90e5ef49d84ed934 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:49.756030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee668-3fd9-41f0-b241-da93b4994e54 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:49.848819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee668-3fd9-41f0-b241-da93b4994e54 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:49.880426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927777-01ad-45ea-98b7-bf803be5d5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:49.881056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927777-01ad-45ea-98b7-bf803be5d5a3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:49.881353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927777-01ad-45ea-98b7-bf803be5d5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:49.881669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927777-01ad-45ea-98b7-bf803be5d5a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:49.943408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927777-01ad-45ea-98b7-bf803be5d5a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:49.944853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927777-01ad-45ea-98b7-bf803be5d5a3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:50.034599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 570/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 18:47:50.040991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b162f6-febd-4bcf-b6bc-ecc621ec3282 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:50.138246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b162f6-febd-4bcf-b6bc-ecc621ec3282 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:50.170883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f86495-4eaa-4d37-b1f2-3fb5de09c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:50.171708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f86495-4eaa-4d37-b1f2-3fb5de09c048 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:50.171985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f86495-4eaa-4d37-b1f2-3fb5de09c048 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:50.172250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f86495-4eaa-4d37-b1f2-3fb5de09c048 None admin] PATH_INFO: `/v3/projects/afe85a9f336f4d0ebc105f6ef1e802da` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:50.173388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f86495-4eaa-4d37-b1f2-3fb5de09c048 None admin] RBAC: Authorizing `identity:get_project(project_id=afe85a9f336f4d0ebc105f6ef1e802da)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:50.174831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f86495-4eaa-4d37-b1f2-3fb5de09c048 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:50.176480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 590/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:47:50 2022] GET /identity/v3/projects/afe85a9f336f4d0ebc105f6ef1e802da => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:50.182538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927777-01ad-45ea-98b7-bf803be5d5a3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:50.275212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927777-01ad-45ea-98b7-bf803be5d5a3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:50.307719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3d0f-6e4b-4f1d-b27e-f9572b541a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:50.308300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3d0f-6e4b-4f1d-b27e-f9572b541a8d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:50.308581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3d0f-6e4b-4f1d-b27e-f9572b541a8d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:50.308851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3d0f-6e4b-4f1d-b27e-f9572b541a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:50.309759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3d0f-6e4b-4f1d-b27e-f9572b541a8d None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=afe85a9f336f4d0ebc105f6ef1e802da, user.id=6c1cae681a34468a90e5ef49d84ed934) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:50.310068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3d0f-6e4b-4f1d-b27e-f9572b541a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:50.311473 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3d0f-6e4b-4f1d-b27e-f9572b541a8d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:50.317022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 571/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:47:50 2022] GET /identity/v3/role_assignments?user.id=6c1cae681a34468a90e5ef49d84ed934&scope.project.id=afe85a9f336f4d0ebc105f6ef1e802da&role.id=d03e020b3fb34446bbf5893b28904483 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:52.576499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801161e-e995-42e5-b3fc-0b9b4b647e1e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:52.577027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801161e-e995-42e5-b3fc-0b9b4b647e1e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:52.577027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801161e-e995-42e5-b3fc-0b9b4b647e1e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:52.578417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 591/1162] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:52.583767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b0688-033c-4341-8dec-b09c52d72b69 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:52.584163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b0688-033c-4341-8dec-b09c52d72b69 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:52.584849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b0688-033c-4341-8dec-b09c52d72b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:52.601951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4e6b0688-033c-4341-8dec-b09c52d72b69 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:52.603127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4e6b0688-033c-4341-8dec-b09c52d72b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:52.665052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 572/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:52.687261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801161e-e995-42e5-b3fc-0b9b4b647e1e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:52.789147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801161e-e995-42e5-b3fc-0b9b4b647e1e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:52.822200 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5b9e9-7e7d-4b96-b6a0-69dbf161bfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:52.822833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5b9e9-7e7d-4b96-b6a0-69dbf161bfba None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:52.823113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5b9e9-7e7d-4b96-b6a0-69dbf161bfba None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:52.823384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5b9e9-7e7d-4b96-b6a0-69dbf161bfba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:52.885062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5b9e9-7e7d-4b96-b6a0-69dbf161bfba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:52.886445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5b9e9-7e7d-4b96-b6a0-69dbf161bfba None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:52.976427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 592/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:47:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:47:52.982392 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b0688-033c-4341-8dec-b09c52d72b69 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:53.074339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b0688-033c-4341-8dec-b09c52d72b69 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:53.106114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091bd98-c1a4-45d1-ac7f-0a6ea123aa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:53.106889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091bd98-c1a4-45d1-ac7f-0a6ea123aa6c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:53.107172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091bd98-c1a4-45d1-ac7f-0a6ea123aa6c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:53.107446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091bd98-c1a4-45d1-ac7f-0a6ea123aa6c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:53.113861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091bd98-c1a4-45d1-ac7f-0a6ea123aa6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:53.115294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091bd98-c1a4-45d1-ac7f-0a6ea123aa6c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-8091bd98-c1a4-45d1-ac7f-0a6ea123aa6c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:47:53.129518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:47:53.130883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:47:53.132492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 573/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:47:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:47:53.137821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5b9e9-7e7d-4b96-b6a0-69dbf161bfba None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:53.231216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5b9e9-7e7d-4b96-b6a0-69dbf161bfba None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:53.263773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84789c8-2478-4115-abd4-5327ef82833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:53.264419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84789c8-2478-4115-abd4-5327ef82833f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:53.264702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84789c8-2478-4115-abd4-5327ef82833f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:53.264976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84789c8-2478-4115-abd4-5327ef82833f None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:53.265715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84789c8-2478-4115-abd4-5327ef82833f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:47:53.266023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84789c8-2478-4115-abd4-5327ef82833f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:53.267380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84789c8-2478-4115-abd4-5327ef82833f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:53.274339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 593/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 12 18:47:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:47:55.438230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad0c86-d27f-46db-bab1-46a87be44d57 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:55.438766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad0c86-d27f-46db-bab1-46a87be44d57 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:55.438766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad0c86-d27f-46db-bab1-46a87be44d57 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:55.440171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 574/1167] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:55.445358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573acb91-a0e7-4456-ad65-9fda97cbdba0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:55.445813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573acb91-a0e7-4456-ad65-9fda97cbdba0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:55.445946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573acb91-a0e7-4456-ad65-9fda97cbdba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:55.463311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-573acb91-a0e7-4456-ad65-9fda97cbdba0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:55.464470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-573acb91-a0e7-4456-ad65-9fda97cbdba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:55.526895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 594/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:47:55.550581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad0c86-d27f-46db-bab1-46a87be44d57 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:55.645512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad0c86-d27f-46db-bab1-46a87be44d57 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:55.678008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99f051-0241-4071-8b7d-040b7cd4d7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:55.678649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99f051-0241-4071-8b7d-040b7cd4d7af None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:55.678932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99f051-0241-4071-8b7d-040b7cd4d7af None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:55.679208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99f051-0241-4071-8b7d-040b7cd4d7af None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:55.679943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99f051-0241-4071-8b7d-040b7cd4d7af None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:55.681302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99f051-0241-4071-8b7d-040b7cd4d7af None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:55.696056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 575/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu May 12 18:47:55 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:47:57.900824 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddbcc-419d-4346-a3a8-bd1ef1c43966 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:57.901357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddbcc-419d-4346-a3a8-bd1ef1c43966 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:57.901357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddbcc-419d-4346-a3a8-bd1ef1c43966 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:57.902740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 595/1170] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:47:57.907879 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d75bf-2744-488c-9a73-fa25bfa09dae None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:57.908281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d75bf-2744-488c-9a73-fa25bfa09dae None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:57.908437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d75bf-2744-488c-9a73-fa25bfa09dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:57.924776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-963d75bf-2744-488c-9a73-fa25bfa09dae None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:47:57.925990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-963d75bf-2744-488c-9a73-fa25bfa09dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:47:57.989408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 576/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:47:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:47:58.012754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddbcc-419d-4346-a3a8-bd1ef1c43966 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:58.109025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddbcc-419d-4346-a3a8-bd1ef1c43966 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:58.140601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c35afb-06b2-44e5-aeb7-224087ee37f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:58.141433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c35afb-06b2-44e5-aeb7-224087ee37f9 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:58.141737 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c35afb-06b2-44e5-aeb7-224087ee37f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:58.142008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c35afb-06b2-44e5-aeb7-224087ee37f9 None admin] PATH_INFO: `/v3/domains/595ee6b82f304a97ab7bee6369dcf5e5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:58.152325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c35afb-06b2-44e5-aeb7-224087ee37f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=595ee6b82f304a97ab7bee6369dcf5e5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:58.153745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c35afb-06b2-44e5-aeb7-224087ee37f9 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:58.155338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 596/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu May 12 18:47:58 2022] GET /identity/v3/domains/595ee6b82f304a97ab7bee6369dcf5e5 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:47:58.161041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d75bf-2744-488c-9a73-fa25bfa09dae None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:47:58.252961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d75bf-2744-488c-9a73-fa25bfa09dae None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:47:58.284509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569c30d-6b65-4022-b95d-ed34925bd170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:47:58.285151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c30d-6b65-4022-b95d-ed34925bd170 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:47:58.285433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c30d-6b65-4022-b95d-ed34925bd170 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:47:58.285737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c30d-6b65-4022-b95d-ed34925bd170 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:47:58.286435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569c30d-6b65-4022-b95d-ed34925bd170 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:47:58.288439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569c30d-6b65-4022-b95d-ed34925bd170 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:47:58.315853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 577/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:47:58 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:48:00.531349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691ec9-b901-449b-99a7-b3f2ba51ac0a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:00.531882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691ec9-b901-449b-99a7-b3f2ba51ac0a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:00.531882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691ec9-b901-449b-99a7-b3f2ba51ac0a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:00.533234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 597/1174] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:48:00.538996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2876e-e3d1-47c6-ae56-426d0a1c01e0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:00.539383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2876e-e3d1-47c6-ae56-426d0a1c01e0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:00.539560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2876e-e3d1-47c6-ae56-426d0a1c01e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:00.556553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-eff2876e-e3d1-47c6-ae56-426d0a1c01e0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:48:00.557761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-eff2876e-e3d1-47c6-ae56-426d0a1c01e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:48:00.619532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 578/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:48:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:48:00.643603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691ec9-b901-449b-99a7-b3f2ba51ac0a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:00.739404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691ec9-b901-449b-99a7-b3f2ba51ac0a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:00.769623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c947c8-100f-4ef3-8edb-c98135b84fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:00.770456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c947c8-100f-4ef3-8edb-c98135b84fb0 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:00.770733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c947c8-100f-4ef3-8edb-c98135b84fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:00.771002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c947c8-100f-4ef3-8edb-c98135b84fb0 None admin] PATH_INFO: `/v3/domains/595ee6b82f304a97ab7bee6369dcf5e5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:00.772709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c947c8-100f-4ef3-8edb-c98135b84fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=595ee6b82f304a97ab7bee6369dcf5e5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:00.774165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c947c8-100f-4ef3-8edb-c98135b84fb0 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:00.775757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 598/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu May 12 18:48:00 2022] GET /identity/v3/domains/595ee6b82f304a97ab7bee6369dcf5e5 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:00.781768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2876e-e3d1-47c6-ae56-426d0a1c01e0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:00.876462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2876e-e3d1-47c6-ae56-426d0a1c01e0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:00.908972 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef1244-38f9-4208-9200-48bc8416d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:00.909657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1244-38f9-4208-9200-48bc8416d033 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:00.909940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1244-38f9-4208-9200-48bc8416d033 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:00.910208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1244-38f9-4208-9200-48bc8416d033 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:00.910910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef1244-38f9-4208-9200-48bc8416d033 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:00.912339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef1244-38f9-4208-9200-48bc8416d033 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:00.932206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 579/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:48:00 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:48:03.139666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5fe06-d3ae-47f7-b1ac-584b951e796f None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:03.140079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5fe06-d3ae-47f7-b1ac-584b951e796f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:03.140206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5fe06-d3ae-47f7-b1ac-584b951e796f None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:03.141642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 599/1178] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:48:03.147451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518d7f-e7d1-4e86-a9a9-973f69e712f3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:03.147848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518d7f-e7d1-4e86-a9a9-973f69e712f3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:03.148012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518d7f-e7d1-4e86-a9a9-973f69e712f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:03.164622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-22518d7f-e7d1-4e86-a9a9-973f69e712f3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:48:03.165832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-22518d7f-e7d1-4e86-a9a9-973f69e712f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:48:03.228694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 580/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:48:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:48:03.251653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5fe06-d3ae-47f7-b1ac-584b951e796f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:03.351505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5fe06-d3ae-47f7-b1ac-584b951e796f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:03.383083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121b7b-67a3-4c8e-b04a-8357022f8a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:03.383793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121b7b-67a3-4c8e-b04a-8357022f8a96 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:03.384075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121b7b-67a3-4c8e-b04a-8357022f8a96 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:03.384349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121b7b-67a3-4c8e-b04a-8357022f8a96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:03.394372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25121b7b-67a3-4c8e-b04a-8357022f8a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-25121b7b-67a3-4c8e-b04a-8357022f8a96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:48:03.402572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:48:03.403759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:48:03.404873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 600/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:48:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:48:03.409781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518d7f-e7d1-4e86-a9a9-973f69e712f3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:03.502074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518d7f-e7d1-4e86-a9a9-973f69e712f3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:03.534192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5263d5-37a5-4b0d-b777-6844fe459cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:03.534841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5263d5-37a5-4b0d-b777-6844fe459cdc None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:03.535123 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5263d5-37a5-4b0d-b777-6844fe459cdc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:03.535398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5263d5-37a5-4b0d-b777-6844fe459cdc None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:03.536145 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5263d5-37a5-4b0d-b777-6844fe459cdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:48:03.536472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5263d5-37a5-4b0d-b777-6844fe459cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:03.537885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5263d5-37a5-4b0d-b777-6844fe459cdc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:03.545817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 581/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:48:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:03.551454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121b7b-67a3-4c8e-b04a-8357022f8a96 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:03.645395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121b7b-67a3-4c8e-b04a-8357022f8a96 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:03.679828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d81c2-f8ba-451e-9f13-df1103a1571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:03.680676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d81c2-f8ba-451e-9f13-df1103a1571d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:03.680956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d81c2-f8ba-451e-9f13-df1103a1571d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:03.681227 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d81c2-f8ba-451e-9f13-df1103a1571d None admin] PATH_INFO: `/v3/users/432d8e32dea44bcfa3d56929f4136932` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:03.694475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d81c2-f8ba-451e-9f13-df1103a1571d None admin] RBAC: Authorizing `identity:get_user(user_id=432d8e32dea44bcfa3d56929f4136932)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:03.695915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d81c2-f8ba-451e-9f13-df1103a1571d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:03.697560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 601/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:48:03 2022] GET /identity/v3/users/432d8e32dea44bcfa3d56929f4136932 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:03.703255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5263d5-37a5-4b0d-b777-6844fe459cdc None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:03.796035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5263d5-37a5-4b0d-b777-6844fe459cdc None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:03.827658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdfcb1-5874-42c1-893e-dfa191286e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:03.828286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdfcb1-5874-42c1-893e-dfa191286e65 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:03.828568 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdfcb1-5874-42c1-893e-dfa191286e65 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:03.828838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdfcb1-5874-42c1-893e-dfa191286e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:03.890739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdfcb1-5874-42c1-893e-dfa191286e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:03.892164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdfcb1-5874-42c1-893e-dfa191286e65 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:03.985847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 582/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:48:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 18:48:03.992253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d81c2-f8ba-451e-9f13-df1103a1571d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:04.084892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d81c2-f8ba-451e-9f13-df1103a1571d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:04.116790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664be33-6018-40f4-ae27-3fcf384daf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:04.117644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664be33-6018-40f4-ae27-3fcf384daf08 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:04.117926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664be33-6018-40f4-ae27-3fcf384daf08 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:04.118196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664be33-6018-40f4-ae27-3fcf384daf08 None admin] PATH_INFO: `/v3/projects/17452d37d3ed4eb5a653094d5db355ae` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:04.119342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664be33-6018-40f4-ae27-3fcf384daf08 None admin] RBAC: Authorizing `identity:get_project(project_id=17452d37d3ed4eb5a653094d5db355ae)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:04.120769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664be33-6018-40f4-ae27-3fcf384daf08 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:04.122477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 602/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:48:03 2022] GET /identity/v3/projects/17452d37d3ed4eb5a653094d5db355ae => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:04.128372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdfcb1-5874-42c1-893e-dfa191286e65 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:04.219878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdfcb1-5874-42c1-893e-dfa191286e65 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:04.251775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c8923-b5dd-4012-9be7-bcd9a2225011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:04.252352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c8923-b5dd-4012-9be7-bcd9a2225011 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:04.252628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c8923-b5dd-4012-9be7-bcd9a2225011 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:04.252894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c8923-b5dd-4012-9be7-bcd9a2225011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:04.253734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c8923-b5dd-4012-9be7-bcd9a2225011 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=17452d37d3ed4eb5a653094d5db355ae, user.id=432d8e32dea44bcfa3d56929f4136932) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:48:04.254042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c8923-b5dd-4012-9be7-bcd9a2225011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:04.255495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c8923-b5dd-4012-9be7-bcd9a2225011 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:04.260614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 583/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:48:04 2022] GET /identity/v3/role_assignments?user.id=432d8e32dea44bcfa3d56929f4136932&scope.project.id=17452d37d3ed4eb5a653094d5db355ae&role.id=d03e020b3fb34446bbf5893b28904483 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:06.436368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1805-3539-40e7-bd7a-d459045ff428 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:06.436896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1805-3539-40e7-bd7a-d459045ff428 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:06.436896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1805-3539-40e7-bd7a-d459045ff428 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:06.438347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 603/1186] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:48:06.444190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37519-7794-4212-b0b3-0ee69ff73ccf None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:06.444628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37519-7794-4212-b0b3-0ee69ff73ccf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:06.444745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37519-7794-4212-b0b3-0ee69ff73ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:06.461467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b5c37519-7794-4212-b0b3-0ee69ff73ccf None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:48:06.462660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b5c37519-7794-4212-b0b3-0ee69ff73ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:48:06.525776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 584/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:48:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:48:06.548085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1805-3539-40e7-bd7a-d459045ff428 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:06.643350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1805-3539-40e7-bd7a-d459045ff428 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:06.674444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b400e-8350-492d-b82a-f6d108a7f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:06.675207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b400e-8350-492d-b82a-f6d108a7f62f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:06.675485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b400e-8350-492d-b82a-f6d108a7f62f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:06.675754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b400e-8350-492d-b82a-f6d108a7f62f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:06.685845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b400e-8350-492d-b82a-f6d108a7f62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-785b400e-8350-492d-b82a-f6d108a7f62f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:48:06.693900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:48:06.694983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:48:06.696157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 604/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:48:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:48:06.700756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37519-7794-4212-b0b3-0ee69ff73ccf None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:06.790964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37519-7794-4212-b0b3-0ee69ff73ccf None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:06.823506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eda397-82aa-4e7b-b8af-35ef0dd23e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:06.824150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eda397-82aa-4e7b-b8af-35ef0dd23e1a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:06.824427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eda397-82aa-4e7b-b8af-35ef0dd23e1a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:06.824694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eda397-82aa-4e7b-b8af-35ef0dd23e1a None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:06.825433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eda397-82aa-4e7b-b8af-35ef0dd23e1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:48:06.825766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eda397-82aa-4e7b-b8af-35ef0dd23e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:06.827101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eda397-82aa-4e7b-b8af-35ef0dd23e1a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:06.834623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 585/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:48:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:06.840133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b400e-8350-492d-b82a-f6d108a7f62f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:06.952022 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b400e-8350-492d-b82a-f6d108a7f62f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:06.982860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499e64-fa6f-44da-9cb1-ab53a6809a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:06.983706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499e64-fa6f-44da-9cb1-ab53a6809a40 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:06.983981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499e64-fa6f-44da-9cb1-ab53a6809a40 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:06.984250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499e64-fa6f-44da-9cb1-ab53a6809a40 None admin] PATH_INFO: `/v3/users/432d8e32dea44bcfa3d56929f4136932` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:06.985391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99499e64-fa6f-44da-9cb1-ab53a6809a40 None admin] RBAC: Authorizing `identity:get_user(user_id=432d8e32dea44bcfa3d56929f4136932)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:06.986839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99499e64-fa6f-44da-9cb1-ab53a6809a40 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:06.988431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 605/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:48:06 2022] GET /identity/v3/users/432d8e32dea44bcfa3d56929f4136932 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:06.994727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eda397-82aa-4e7b-b8af-35ef0dd23e1a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:07.087650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eda397-82aa-4e7b-b8af-35ef0dd23e1a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:07.119802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938ddf5-def2-473f-90a6-b348e7148a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:07.120638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938ddf5-def2-473f-90a6-b348e7148a70 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:07.120921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938ddf5-def2-473f-90a6-b348e7148a70 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:07.121198 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938ddf5-def2-473f-90a6-b348e7148a70 None admin] PATH_INFO: `/v3/projects/17452d37d3ed4eb5a653094d5db355ae` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:07.122399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938ddf5-def2-473f-90a6-b348e7148a70 None admin] RBAC: Authorizing `identity:get_project(project_id=17452d37d3ed4eb5a653094d5db355ae)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:07.123828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938ddf5-def2-473f-90a6-b348e7148a70 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:07.125705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 586/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:48:06 2022] GET /identity/v3/projects/17452d37d3ed4eb5a653094d5db355ae => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:07.131516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499e64-fa6f-44da-9cb1-ab53a6809a40 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:07.225518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499e64-fa6f-44da-9cb1-ab53a6809a40 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:07.256784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cc18c-94ea-4308-8109-6b4e7f778e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:07.257680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc18c-94ea-4308-8109-6b4e7f778e0d None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:07.257963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc18c-94ea-4308-8109-6b4e7f778e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:07.258239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc18c-94ea-4308-8109-6b4e7f778e0d None admin] PATH_INFO: `/v3/projects/17452d37d3ed4eb5a653094d5db355ae/users/432d8e32dea44bcfa3d56929f4136932/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:07.260169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cc18c-94ea-4308-8109-6b4e7f778e0d None admin] RBAC: Authorizing `identity:create_grant(project_id=17452d37d3ed4eb5a653094d5db355ae, user_id=432d8e32dea44bcfa3d56929f4136932, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:07.261611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cc18c-94ea-4308-8109-6b4e7f778e0d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:07.274375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 606/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:48:07 2022] PUT /identity/v3/projects/17452d37d3ed4eb5a653094d5db355ae/users/432d8e32dea44bcfa3d56929f4136932/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:48:09.455615 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153413f-cedc-4ba4-b494-2c4cfab8ae0e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:09.456147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153413f-cedc-4ba4-b494-2c4cfab8ae0e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:09.456256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153413f-cedc-4ba4-b494-2c4cfab8ae0e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:09.457559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 587/1193] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:48:09.462728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4be12-55c7-4995-8db8-082b86899670 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:09.463158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4be12-55c7-4995-8db8-082b86899670 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:09.463286 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4be12-55c7-4995-8db8-082b86899670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:09.479851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c7f4be12-55c7-4995-8db8-082b86899670 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:48:09.481013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c7f4be12-55c7-4995-8db8-082b86899670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:48:09.542498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 607/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:48:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:48:09.566466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153413f-cedc-4ba4-b494-2c4cfab8ae0e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:09.662452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153413f-cedc-4ba4-b494-2c4cfab8ae0e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:09.693737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0232601-f1a3-45fc-b39f-ebb1ee82fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:09.694509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232601-f1a3-45fc-b39f-ebb1ee82fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:09.694793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232601-f1a3-45fc-b39f-ebb1ee82fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:09.695069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232601-f1a3-45fc-b39f-ebb1ee82fdf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:09.704611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0232601-f1a3-45fc-b39f-ebb1ee82fdf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-b0232601-f1a3-45fc-b39f-ebb1ee82fdf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:48:09.712759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:48:09.714017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:48:09.715208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 588/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:48:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:48:09.719727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4be12-55c7-4995-8db8-082b86899670 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:09.812042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4be12-55c7-4995-8db8-082b86899670 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:09.843778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc326c88-7d22-4281-a9fc-9769befaacbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:09.844430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc326c88-7d22-4281-a9fc-9769befaacbb None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:09.844710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc326c88-7d22-4281-a9fc-9769befaacbb None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:09.844982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc326c88-7d22-4281-a9fc-9769befaacbb None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:09.845741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc326c88-7d22-4281-a9fc-9769befaacbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:48:09.846045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc326c88-7d22-4281-a9fc-9769befaacbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:09.847406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc326c88-7d22-4281-a9fc-9769befaacbb None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:09.855632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 608/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:48:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:09.861139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0232601-f1a3-45fc-b39f-ebb1ee82fdf4 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:09.953795 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0232601-f1a3-45fc-b39f-ebb1ee82fdf4 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:09.984567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba95b6-9010-4cba-8be8-75fbaf9d0e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:09.985346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba95b6-9010-4cba-8be8-75fbaf9d0e5d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:09.985654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba95b6-9010-4cba-8be8-75fbaf9d0e5d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:09.985929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba95b6-9010-4cba-8be8-75fbaf9d0e5d None admin] PATH_INFO: `/v3/users/432d8e32dea44bcfa3d56929f4136932` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:09.987083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba95b6-9010-4cba-8be8-75fbaf9d0e5d None admin] RBAC: Authorizing `identity:get_user(user_id=432d8e32dea44bcfa3d56929f4136932)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:09.988490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba95b6-9010-4cba-8be8-75fbaf9d0e5d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:09.990091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 589/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 12 18:48:09 2022] GET /identity/v3/users/432d8e32dea44bcfa3d56929f4136932 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:09.995524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc326c88-7d22-4281-a9fc-9769befaacbb None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:10.089289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc326c88-7d22-4281-a9fc-9769befaacbb None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:10.120432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912a8f-ac97-4c48-adf1-bbee5dba6f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:10.121062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912a8f-ac97-4c48-adf1-bbee5dba6f1e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:10.121341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912a8f-ac97-4c48-adf1-bbee5dba6f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:10.121645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912a8f-ac97-4c48-adf1-bbee5dba6f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:10.184605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53912a8f-ac97-4c48-adf1-bbee5dba6f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:10.186108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53912a8f-ac97-4c48-adf1-bbee5dba6f1e None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:10.277194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 609/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:48:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:48:10.283043 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba95b6-9010-4cba-8be8-75fbaf9d0e5d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:10.376411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba95b6-9010-4cba-8be8-75fbaf9d0e5d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:10.407672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0b100-6310-478e-a170-e7033957268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:10.408508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0b100-6310-478e-a170-e7033957268a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:10.408787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0b100-6310-478e-a170-e7033957268a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:10.409060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0b100-6310-478e-a170-e7033957268a None admin] PATH_INFO: `/v3/projects/17452d37d3ed4eb5a653094d5db355ae` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:10.410186 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0b100-6310-478e-a170-e7033957268a None admin] RBAC: Authorizing `identity:get_project(project_id=17452d37d3ed4eb5a653094d5db355ae)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:10.411647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0b100-6310-478e-a170-e7033957268a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:10.413292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 590/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 12 18:48:10 2022] GET /identity/v3/projects/17452d37d3ed4eb5a653094d5db355ae => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:48:10.419384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912a8f-ac97-4c48-adf1-bbee5dba6f1e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:48:10.512164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912a8f-ac97-4c48-adf1-bbee5dba6f1e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:48:10.543913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b64153-2efc-47f7-99b1-1c0d95fa0d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:48:10.544487 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b64153-2efc-47f7-99b1-1c0d95fa0d97 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:48:10.544770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b64153-2efc-47f7-99b1-1c0d95fa0d97 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:48:10.545043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b64153-2efc-47f7-99b1-1c0d95fa0d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:48:10.545889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b64153-2efc-47f7-99b1-1c0d95fa0d97 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=17452d37d3ed4eb5a653094d5db355ae, user.id=432d8e32dea44bcfa3d56929f4136932) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:48:10.546200 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b64153-2efc-47f7-99b1-1c0d95fa0d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:48:10.547607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b64153-2efc-47f7-99b1-1c0d95fa0d97 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:48:10.553800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 610/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:48:10 2022] GET /identity/v3/role_assignments?user.id=432d8e32dea44bcfa3d56929f4136932&scope.project.id=17452d37d3ed4eb5a653094d5db355ae&role.id=d03e020b3fb34446bbf5893b28904483 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:10.467841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c8103-8116-44b6-bf62-f209d66070a4 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:10.468517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c8103-8116-44b6-bf62-f209d66070a4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:10.468517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c8103-8116-44b6-bf62-f209d66070a4 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:10.470350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 591/1201] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:10.476724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0942f-cfa5-4443-b884-9c7e389bed58 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:10.477251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0942f-cfa5-4443-b884-9c7e389bed58 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:10.477350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0942f-cfa5-4443-b884-9c7e389bed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:10.499989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-74f0942f-cfa5-4443-b884-9c7e389bed58 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:10.501444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-74f0942f-cfa5-4443-b884-9c7e389bed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:10.588483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 611/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:49:10.616259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c8103-8116-44b6-bf62-f209d66070a4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:10.753865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c8103-8116-44b6-bf62-f209d66070a4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:10.795891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58cf0b-c33e-411a-96a6-7bd26cb7d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:10.796767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58cf0b-c33e-411a-96a6-7bd26cb7d4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:10.797006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58cf0b-c33e-411a-96a6-7bd26cb7d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:10.797236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58cf0b-c33e-411a-96a6-7bd26cb7d4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:10.809721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58cf0b-c33e-411a-96a6-7bd26cb7d4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:10.811526 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58cf0b-c33e-411a-96a6-7bd26cb7d4a8 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5f58cf0b-c33e-411a-96a6-7bd26cb7d4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:10.832275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:10.837876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:10.839561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:10.839561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:10.839561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:10.839561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:10.839561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 592/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:10.839881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0942f-cfa5-4443-b884-9c7e389bed58 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:10.958682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0942f-cfa5-4443-b884-9c7e389bed58 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:10.998985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bc5b1-b1fd-451c-8b38-747ea4a40f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:10.999692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bc5b1-b1fd-451c-8b38-747ea4a40f18 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:10.999974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bc5b1-b1fd-451c-8b38-747ea4a40f18 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:11.000277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bc5b1-b1fd-451c-8b38-747ea4a40f18 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:11.000975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bc5b1-b1fd-451c-8b38-747ea4a40f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:11.001298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bc5b1-b1fd-451c-8b38-747ea4a40f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:11.003239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bc5b1-b1fd-451c-8b38-747ea4a40f18 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:11.017063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 612/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:49:11.023291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58cf0b-c33e-411a-96a6-7bd26cb7d4a8 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:11.148039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58cf0b-c33e-411a-96a6-7bd26cb7d4a8 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:11.200382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675ed96-df8b-4747-beb6-42ee70d99bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:11.201183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675ed96-df8b-4747-beb6-42ee70d99bb6 None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:11.201497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675ed96-df8b-4747-beb6-42ee70d99bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:11.201798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675ed96-df8b-4747-beb6-42ee70d99bb6 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:11.202610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675ed96-df8b-4747-beb6-42ee70d99bb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:11.204153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675ed96-df8b-4747-beb6-42ee70d99bb6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:11.224558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 593/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 12 18:49:11 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:49:13.714149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128c15-eedf-4d16-a632-b4d75403dae2 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:13.714724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128c15-eedf-4d16-a632-b4d75403dae2 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:13.714831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128c15-eedf-4d16-a632-b4d75403dae2 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:13.716590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 613/1206] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:13.722207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b701f2d-d0f0-4d00-8a46-1dabb8050382 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:13.722704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b701f2d-d0f0-4d00-8a46-1dabb8050382 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:13.722789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b701f2d-d0f0-4d00-8a46-1dabb8050382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:13.742739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8b701f2d-d0f0-4d00-8a46-1dabb8050382 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:13.743952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8b701f2d-d0f0-4d00-8a46-1dabb8050382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:13.823873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 594/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:49:13.850012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f128c15-eedf-4d16-a632-b4d75403dae2 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:13.968228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f128c15-eedf-4d16-a632-b4d75403dae2 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:14.005877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f7e94-71d8-4324-a91e-544964ade3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:14.006671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f7e94-71d8-4324-a91e-544964ade3f1 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:14.007344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f7e94-71d8-4324-a91e-544964ade3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:14.007344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f7e94-71d8-4324-a91e-544964ade3f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:14.019300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f7e94-71d8-4324-a91e-544964ade3f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-732f7e94-71d8-4324-a91e-544964ade3f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:49:14.027001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:14.028463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:14.029338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 614/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:49:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:14.038560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b701f2d-d0f0-4d00-8a46-1dabb8050382 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:14.151142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b701f2d-d0f0-4d00-8a46-1dabb8050382 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:14.190001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82492f1a-1867-4db0-be8d-cd1b8d4d4e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:14.190974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82492f1a-1867-4db0-be8d-cd1b8d4d4e88 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:14.191303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82492f1a-1867-4db0-be8d-cd1b8d4d4e88 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:14.191583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82492f1a-1867-4db0-be8d-cd1b8d4d4e88 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:14.192462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82492f1a-1867-4db0-be8d-cd1b8d4d4e88 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:14.192799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82492f1a-1867-4db0-be8d-cd1b8d4d4e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:14.194556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82492f1a-1867-4db0-be8d-cd1b8d4d4e88 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:14.204781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 595/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:49:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:14.210925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f7e94-71d8-4324-a91e-544964ade3f1 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:14.333615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f7e94-71d8-4324-a91e-544964ade3f1 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:14.370868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202455a-d8b5-4466-bea7-a9cd7e13c945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:14.371655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202455a-d8b5-4466-bea7-a9cd7e13c945 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:14.372017 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202455a-d8b5-4466-bea7-a9cd7e13c945 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:14.372231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202455a-d8b5-4466-bea7-a9cd7e13c945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:14.383285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202455a-d8b5-4466-bea7-a9cd7e13c945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:14.384762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202455a-d8b5-4466-bea7-a9cd7e13c945 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-1202455a-d8b5-4466-bea7-a9cd7e13c945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:14.403082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:14.404096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:14.405334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:14.405334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:14.405334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:14.405334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:14.405334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 615/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:14.410654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82492f1a-1867-4db0-be8d-cd1b8d4d4e88 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:14.521382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82492f1a-1867-4db0-be8d-cd1b8d4d4e88 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:14.560462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486750f-b731-4394-b901-93fe042ec2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:14.561136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486750f-b731-4394-b901-93fe042ec2e0 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:14.561401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486750f-b731-4394-b901-93fe042ec2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:14.561707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486750f-b731-4394-b901-93fe042ec2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:14.562429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486750f-b731-4394-b901-93fe042ec2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:14.562735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486750f-b731-4394-b901-93fe042ec2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:14.564135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486750f-b731-4394-b901-93fe042ec2e0 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:14.577247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 596/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:14.585169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202455a-d8b5-4466-bea7-a9cd7e13c945 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:14.702439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202455a-d8b5-4466-bea7-a9cd7e13c945 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:14.742296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5b645-e905-452b-aa81-44c7f15fcd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:14.743338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5b645-e905-452b-aa81-44c7f15fcd14 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:14.743796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5b645-e905-452b-aa81-44c7f15fcd14 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:14.744199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5b645-e905-452b-aa81-44c7f15fcd14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:14.752376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5b645-e905-452b-aa81-44c7f15fcd14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:14.753956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5b645-e905-452b-aa81-44c7f15fcd14 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-69c5b645-e905-452b-aa81-44c7f15fcd14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:49:14.768976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:14.770731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:14.772488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 616/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:14.778253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486750f-b731-4394-b901-93fe042ec2e0 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:14.891833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486750f-b731-4394-b901-93fe042ec2e0 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:14.931783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be61e8e-24d8-4a6d-a3a3-699cae8bcbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:14.932790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61e8e-24d8-4a6d-a3a3-699cae8bcbe6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:14.933294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61e8e-24d8-4a6d-a3a3-699cae8bcbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:14.933440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61e8e-24d8-4a6d-a3a3-699cae8bcbe6 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:14.935528 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be61e8e-24d8-4a6d-a3a3-699cae8bcbe6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:14.936139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be61e8e-24d8-4a6d-a3a3-699cae8bcbe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:14.939285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be61e8e-24d8-4a6d-a3a3-699cae8bcbe6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:14.960482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 597/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 12 18:49:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:14.966599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5b645-e905-452b-aa81-44c7f15fcd14 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:15.084455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5b645-e905-452b-aa81-44c7f15fcd14 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:15.120645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c1cf3-fa71-40a2-ae93-c33dc873626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:15.121335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c1cf3-fa71-40a2-ae93-c33dc873626a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:15.121686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c1cf3-fa71-40a2-ae93-c33dc873626a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:15.121962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c1cf3-fa71-40a2-ae93-c33dc873626a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:15.196682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c1cf3-fa71-40a2-ae93-c33dc873626a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:15.198279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c1cf3-fa71-40a2-ae93-c33dc873626a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:15.305390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 617/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:49:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 18:49:15.306898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be61e8e-24d8-4a6d-a3a3-699cae8bcbe6 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:15.412488 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be61e8e-24d8-4a6d-a3a3-699cae8bcbe6 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:15.448361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d27d6e-937a-4984-b93c-3ae018e1164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:15.449114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27d6e-937a-4984-b93c-3ae018e1164f None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:15.449370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27d6e-937a-4984-b93c-3ae018e1164f None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:15.449672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27d6e-937a-4984-b93c-3ae018e1164f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:15.460794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d27d6e-937a-4984-b93c-3ae018e1164f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:15.462361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d27d6e-937a-4984-b93c-3ae018e1164f None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-c7d27d6e-937a-4984-b93c-3ae018e1164f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:15.481941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:15.483309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:15.484669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:15.484669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:15.484669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:15.484669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:15.489570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 598/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:49:15.489732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c1cf3-fa71-40a2-ae93-c33dc873626a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:15.592099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c1cf3-fa71-40a2-ae93-c33dc873626a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:15.641900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18303549-62d4-48bf-bd7e-6e4faed7338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:15.642690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18303549-62d4-48bf-bd7e-6e4faed7338d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:15.643101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18303549-62d4-48bf-bd7e-6e4faed7338d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:15.643462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18303549-62d4-48bf-bd7e-6e4faed7338d None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:15.644313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18303549-62d4-48bf-bd7e-6e4faed7338d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:15.644621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18303549-62d4-48bf-bd7e-6e4faed7338d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:15.646154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18303549-62d4-48bf-bd7e-6e4faed7338d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:15.665405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 618/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:15.666922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d27d6e-937a-4984-b93c-3ae018e1164f None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:15.777776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d27d6e-937a-4984-b93c-3ae018e1164f None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:15.819738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82297926-a913-41ed-bfc4-3bf4c1a74fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:15.820542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82297926-a913-41ed-bfc4-3bf4c1a74fb6 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:15.820817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82297926-a913-41ed-bfc4-3bf4c1a74fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:15.821087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82297926-a913-41ed-bfc4-3bf4c1a74fb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:15.827816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82297926-a913-41ed-bfc4-3bf4c1a74fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:15.829238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82297926-a913-41ed-bfc4-3bf4c1a74fb6 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-82297926-a913-41ed-bfc4-3bf4c1a74fb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:49:15.844189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:15.845192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:15.846146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:49:15.846146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:49:15.846146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:49:15.846146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:49:15.846146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:49:15.846146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:49:15.846146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:15.846146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:15.846146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 599/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:49:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 18:49:15.853289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18303549-62d4-48bf-bd7e-6e4faed7338d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:15.968771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18303549-62d4-48bf-bd7e-6e4faed7338d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:16.005443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7fa5b-b93e-48df-ae98-037f36d36c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:16.006161 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7fa5b-b93e-48df-ae98-037f36d36c5c None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:16.006442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7fa5b-b93e-48df-ae98-037f36d36c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:16.006714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7fa5b-b93e-48df-ae98-037f36d36c5c None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:16.007501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7fa5b-b93e-48df-ae98-037f36d36c5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:16.007809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7fa5b-b93e-48df-ae98-037f36d36c5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:16.009259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7fa5b-b93e-48df-ae98-037f36d36c5c None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:16.023409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 619/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:49:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:49:16.029849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82297926-a913-41ed-bfc4-3bf4c1a74fb6 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:16.140307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82297926-a913-41ed-bfc4-3bf4c1a74fb6 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:16.178299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a1c61-ae47-4dc8-8992-8b694bd320b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:16.179159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1c61-ae47-4dc8-8992-8b694bd320b7 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:16.179565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1c61-ae47-4dc8-8992-8b694bd320b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:16.179988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1c61-ae47-4dc8-8992-8b694bd320b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:16.180952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a1c61-ae47-4dc8-8992-8b694bd320b7 None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=cf772e34d8f14923bb9c1fe883fd3926) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:16.181264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a1c61-ae47-4dc8-8992-8b694bd320b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:16.182870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a1c61-ae47-4dc8-8992-8b694bd320b7 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:16.190132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 600/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:49:16 2022] GET /identity/v3/role_assignments?user.id=cf772e34d8f14923bb9c1fe883fd3926&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:18.487520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2161-1bc1-47f7-ab20-c617a7bbf82f None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:18.488123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2161-1bc1-47f7-ab20-c617a7bbf82f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:18.488123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2161-1bc1-47f7-ab20-c617a7bbf82f None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:18.489684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 620/1220] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:18.495122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828fadb-52ac-4990-8b0c-3f6866f409ab None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:18.495547 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828fadb-52ac-4990-8b0c-3f6866f409ab None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:18.495671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828fadb-52ac-4990-8b0c-3f6866f409ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:18.513013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b828fadb-52ac-4990-8b0c-3f6866f409ab None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:18.514242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b828fadb-52ac-4990-8b0c-3f6866f409ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:18.583282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 601/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:49:18.605813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e2161-1bc1-47f7-ab20-c617a7bbf82f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:18.718112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e2161-1bc1-47f7-ab20-c617a7bbf82f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:18.757978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e0f4-9686-4544-9a39-4e6c29eb444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:18.758683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e0f4-9686-4544-9a39-4e6c29eb444a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:18.758958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e0f4-9686-4544-9a39-4e6c29eb444a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:18.759234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e0f4-9686-4544-9a39-4e6c29eb444a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:18.770355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587e0f4-9686-4544-9a39-4e6c29eb444a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-8587e0f4-9686-4544-9a39-4e6c29eb444a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:49:18.779070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:18.780608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:18.781760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 621/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:49:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:18.787125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828fadb-52ac-4990-8b0c-3f6866f409ab None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:18.894876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828fadb-52ac-4990-8b0c-3f6866f409ab None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:18.929846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db8c7-cbb9-406f-8252-252b5d7e8765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:18.930515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db8c7-cbb9-406f-8252-252b5d7e8765 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:18.930804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db8c7-cbb9-406f-8252-252b5d7e8765 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:18.931079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db8c7-cbb9-406f-8252-252b5d7e8765 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:18.931827 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6db8c7-cbb9-406f-8252-252b5d7e8765 None admin] RBAC: Adding query filter params (name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:18.932135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6db8c7-cbb9-406f-8252-252b5d7e8765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:18.933495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6db8c7-cbb9-406f-8252-252b5d7e8765 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:18.941349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 602/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:49:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:18.947428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e0f4-9686-4544-9a39-4e6c29eb444a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:19.049106 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e0f4-9686-4544-9a39-4e6c29eb444a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:19.083277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f42a-dc1c-44dd-b20b-072cfb90b357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:19.084076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f42a-dc1c-44dd-b20b-072cfb90b357 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:19.084357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f42a-dc1c-44dd-b20b-072cfb90b357 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:19.084625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f42a-dc1c-44dd-b20b-072cfb90b357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:19.095507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6f42a-dc1c-44dd-b20b-072cfb90b357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:19.097147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6f42a-dc1c-44dd-b20b-072cfb90b357 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-23b6f42a-dc1c-44dd-b20b-072cfb90b357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:19.120547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:19.121656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:19.122736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:19.122736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:19.122736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:19.122736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:19.122736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 622/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:19.128577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db8c7-cbb9-406f-8252-252b5d7e8765 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:19.237309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db8c7-cbb9-406f-8252-252b5d7e8765 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:19.271132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8db613-d61b-469f-90ca-09f49bc3c49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:19.271793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8db613-d61b-469f-90ca-09f49bc3c49e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:19.272077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8db613-d61b-469f-90ca-09f49bc3c49e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:19.272351 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8db613-d61b-469f-90ca-09f49bc3c49e None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:19.273070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8db613-d61b-469f-90ca-09f49bc3c49e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:19.273373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8db613-d61b-469f-90ca-09f49bc3c49e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:19.274780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8db613-d61b-469f-90ca-09f49bc3c49e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:19.294685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 603/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:19.296061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f42a-dc1c-44dd-b20b-072cfb90b357 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:19.406444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f42a-dc1c-44dd-b20b-072cfb90b357 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:19.442704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289a0a2-e318-4fc0-8a29-99f6a870ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:19.443502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289a0a2-e318-4fc0-8a29-99f6a870ea6b None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:19.443797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289a0a2-e318-4fc0-8a29-99f6a870ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:19.444094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289a0a2-e318-4fc0-8a29-99f6a870ea6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:19.451887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289a0a2-e318-4fc0-8a29-99f6a870ea6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:19.453356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289a0a2-e318-4fc0-8a29-99f6a870ea6b None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-9289a0a2-e318-4fc0-8a29-99f6a870ea6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:49:19.468191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:19.469441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:19.470749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 623/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:19.477518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8db613-d61b-469f-90ca-09f49bc3c49e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:19.581160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8db613-d61b-469f-90ca-09f49bc3c49e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:19.616001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead40c80-8771-456f-803e-a1ed138e9ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:19.616782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead40c80-8771-456f-803e-a1ed138e9ff2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:19.617306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead40c80-8771-456f-803e-a1ed138e9ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:19.617472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead40c80-8771-456f-803e-a1ed138e9ff2 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:19.618453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead40c80-8771-456f-803e-a1ed138e9ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:19.618762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead40c80-8771-456f-803e-a1ed138e9ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:19.620429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead40c80-8771-456f-803e-a1ed138e9ff2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:19.639870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 604/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 12 18:49:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:19.647262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289a0a2-e318-4fc0-8a29-99f6a870ea6b None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:19.753539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289a0a2-e318-4fc0-8a29-99f6a870ea6b None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:19.790933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db3013-300a-4be7-881b-b38041917529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:19.791914 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db3013-300a-4be7-881b-b38041917529 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:19.792237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db3013-300a-4be7-881b-b38041917529 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:19.792538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db3013-300a-4be7-881b-b38041917529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:19.803864 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db3013-300a-4be7-881b-b38041917529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:19.805358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db3013-300a-4be7-881b-b38041917529 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-84db3013-300a-4be7-881b-b38041917529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:19.822634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:19.823727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:19.825122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:19.825122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:19.825122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:19.825122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:19.825122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 624/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:19.831038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead40c80-8771-456f-803e-a1ed138e9ff2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:19.935196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead40c80-8771-456f-803e-a1ed138e9ff2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:19.969088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c86c8-2dca-4a17-b1ae-4249c4ad7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:19.969803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c86c8-2dca-4a17-b1ae-4249c4ad7c53 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:19.970084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c86c8-2dca-4a17-b1ae-4249c4ad7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:19.970358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c86c8-2dca-4a17-b1ae-4249c4ad7c53 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:19.971071 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c86c8-2dca-4a17-b1ae-4249c4ad7c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:19.971377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c86c8-2dca-4a17-b1ae-4249c4ad7c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:19.972736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c86c8-2dca-4a17-b1ae-4249c4ad7c53 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:19.983943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 605/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:19.989564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db3013-300a-4be7-881b-b38041917529 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:20.104927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db3013-300a-4be7-881b-b38041917529 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:20.139730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f988723-d590-45fe-a754-1e1dcafdf44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:20.140685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f988723-d590-45fe-a754-1e1dcafdf44f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:20.140966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f988723-d590-45fe-a754-1e1dcafdf44f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:20.141244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f988723-d590-45fe-a754-1e1dcafdf44f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:20.148769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f988723-d590-45fe-a754-1e1dcafdf44f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:20.150468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f988723-d590-45fe-a754-1e1dcafdf44f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-6f988723-d590-45fe-a754-1e1dcafdf44f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:49:20.167996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:20.169196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:20.170157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:49:20.170157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:49:20.170157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:49:20.170157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:49:20.170157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:49:20.170157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:49:20.170157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:20.170157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:20.170157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 625/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:49:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:20.175986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c86c8-2dca-4a17-b1ae-4249c4ad7c53 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:20.279757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c86c8-2dca-4a17-b1ae-4249c4ad7c53 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:20.316477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0d5c6-6edb-42f7-9d67-cf32953c7215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:20.317273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d5c6-6edb-42f7-9d67-cf32953c7215 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:20.317694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d5c6-6edb-42f7-9d67-cf32953c7215 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:20.317971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d5c6-6edb-42f7-9d67-cf32953c7215 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:20.318779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0d5c6-6edb-42f7-9d67-cf32953c7215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:20.319064 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0d5c6-6edb-42f7-9d67-cf32953c7215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:20.320496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0d5c6-6edb-42f7-9d67-cf32953c7215 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:20.332501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 606/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:49:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:49:20.338640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f988723-d590-45fe-a754-1e1dcafdf44f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:20.441935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f988723-d590-45fe-a754-1e1dcafdf44f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:20.475395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6109ee7-dcd0-4a67-97d3-bb434e781ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:20.476274 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109ee7-dcd0-4a67-97d3-bb434e781ab2 None admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:20.476557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109ee7-dcd0-4a67-97d3-bb434e781ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:20.476833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109ee7-dcd0-4a67-97d3-bb434e781ab2 None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/cf772e34d8f14923bb9c1fe883fd3926/roles/4803c7e1a903431faba9ebef03061c0d` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:20.491676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6109ee7-dcd0-4a67-97d3-bb434e781ab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=cf772e34d8f14923bb9c1fe883fd3926, role_id=4803c7e1a903431faba9ebef03061c0d)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:20.493165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6109ee7-dcd0-4a67-97d3-bb434e781ab2 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:20.504873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 626/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:49:20 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/cf772e34d8f14923bb9c1fe883fd3926/roles/4803c7e1a903431faba9ebef03061c0d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:49:22.758568 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0d6ae-59c6-46b2-952c-db946e0f5a2c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:22.759219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0d6ae-59c6-46b2-952c-db946e0f5a2c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:22.759219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0d6ae-59c6-46b2-952c-db946e0f5a2c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:22.760553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 607/1233] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:49:22.766372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bdc72-1565-4cf6-bbb5-290d68dd7687 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:22.766806 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bdc72-1565-4cf6-bbb5-290d68dd7687 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:22.766961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bdc72-1565-4cf6-bbb5-290d68dd7687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:22.786929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-5c4bdc72-1565-4cf6-bbb5-290d68dd7687 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:22.788379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5c4bdc72-1565-4cf6-bbb5-290d68dd7687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:22.860742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 627/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:49:22.887561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0d6ae-59c6-46b2-952c-db946e0f5a2c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:22.998312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0d6ae-59c6-46b2-952c-db946e0f5a2c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:23.033839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9203a8a-51cb-4577-b047-41097d905066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:23.034715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9203a8a-51cb-4577-b047-41097d905066 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:23.035016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9203a8a-51cb-4577-b047-41097d905066 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:23.035290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9203a8a-51cb-4577-b047-41097d905066 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:23.046682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9203a8a-51cb-4577-b047-41097d905066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-e9203a8a-51cb-4577-b047-41097d905066 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:49:23.056464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:23.057654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:23.058533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 608/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 12 18:49:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:23.064686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bdc72-1565-4cf6-bbb5-290d68dd7687 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:23.178520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bdc72-1565-4cf6-bbb5-290d68dd7687 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:23.217080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566efbbe-e1bb-4088-9ebc-50e1a3c262ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:23.217776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566efbbe-e1bb-4088-9ebc-50e1a3c262ca None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:23.218058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566efbbe-e1bb-4088-9ebc-50e1a3c262ca None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:23.218391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566efbbe-e1bb-4088-9ebc-50e1a3c262ca None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:23.219260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566efbbe-e1bb-4088-9ebc-50e1a3c262ca None admin] RBAC: Adding query filter params (name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:23.220204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566efbbe-e1bb-4088-9ebc-50e1a3c262ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:23.221918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566efbbe-e1bb-4088-9ebc-50e1a3c262ca None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:23.230903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 628/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 12 18:49:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:23.237137 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9203a8a-51cb-4577-b047-41097d905066 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:23.345903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9203a8a-51cb-4577-b047-41097d905066 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:23.383153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97e353-1f2d-425d-a431-dc17970a835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:23.384247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97e353-1f2d-425d-a431-dc17970a835a None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:23.384693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97e353-1f2d-425d-a431-dc17970a835a None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:23.385188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97e353-1f2d-425d-a431-dc17970a835a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:23.397333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97e353-1f2d-425d-a431-dc17970a835a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:23.398794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97e353-1f2d-425d-a431-dc17970a835a None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-dc97e353-1f2d-425d-a431-dc17970a835a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:23.418262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:23.419487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:23.420666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:23.420666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:23.420666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:23.420666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:23.420666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 609/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:23.426065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566efbbe-e1bb-4088-9ebc-50e1a3c262ca None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:23.534394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566efbbe-e1bb-4088-9ebc-50e1a3c262ca None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:23.571088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c2462-9a0e-494e-8eb5-f2d246897515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:23.571749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c2462-9a0e-494e-8eb5-f2d246897515 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:23.572029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c2462-9a0e-494e-8eb5-f2d246897515 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:23.572304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c2462-9a0e-494e-8eb5-f2d246897515 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:23.573016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c2462-9a0e-494e-8eb5-f2d246897515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:23.573321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c2462-9a0e-494e-8eb5-f2d246897515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:23.574730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c2462-9a0e-494e-8eb5-f2d246897515 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:23.585727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 629/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:49:23.591829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97e353-1f2d-425d-a431-dc17970a835a None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:23.707898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97e353-1f2d-425d-a431-dc17970a835a None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:23.748048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3e035-95f4-4b2e-bea6-352b75669376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:23.749022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3e035-95f4-4b2e-bea6-352b75669376 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:23.749341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3e035-95f4-4b2e-bea6-352b75669376 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:23.749648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3e035-95f4-4b2e-bea6-352b75669376 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:23.758252 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3e035-95f4-4b2e-bea6-352b75669376 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:23.759730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3e035-95f4-4b2e-bea6-352b75669376 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-63b3e035-95f4-4b2e-bea6-352b75669376 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:49:23.777041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:23.778426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:23.779594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 610/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:23.784953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c2462-9a0e-494e-8eb5-f2d246897515 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:23.890578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c2462-9a0e-494e-8eb5-f2d246897515 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:23.930562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3c838-3217-45d4-8110-af954dfa87dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:23.931228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3c838-3217-45d4-8110-af954dfa87dc None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:23.931518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3c838-3217-45d4-8110-af954dfa87dc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:23.931805 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3c838-3217-45d4-8110-af954dfa87dc None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:23.932621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3c838-3217-45d4-8110-af954dfa87dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:23.932936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3c838-3217-45d4-8110-af954dfa87dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:23.934401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3c838-3217-45d4-8110-af954dfa87dc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:23.955028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 630/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 12 18:49:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:23.960885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3e035-95f4-4b2e-bea6-352b75669376 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:24.067534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3e035-95f4-4b2e-bea6-352b75669376 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:24.106929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34125bc4-fd71-4ad8-b601-903e886b67bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:24.107584 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125bc4-fd71-4ad8-b601-903e886b67bd None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:24.107872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125bc4-fd71-4ad8-b601-903e886b67bd None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:24.108149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125bc4-fd71-4ad8-b601-903e886b67bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:24.175725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34125bc4-fd71-4ad8-b601-903e886b67bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:24.177157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34125bc4-fd71-4ad8-b601-903e886b67bd None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:24.281602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 611/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:49:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:49:24.287337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3c838-3217-45d4-8110-af954dfa87dc None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:24.385486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3c838-3217-45d4-8110-af954dfa87dc None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:24.421802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5933-fbe0-4c2c-9fe4-1890eda36af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:24.423267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5933-fbe0-4c2c-9fe4-1890eda36af3 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:24.423543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5933-fbe0-4c2c-9fe4-1890eda36af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:24.423951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5933-fbe0-4c2c-9fe4-1890eda36af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:24.436684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e5933-fbe0-4c2c-9fe4-1890eda36af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:24.438282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e5933-fbe0-4c2c-9fe4-1890eda36af3 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-e23e5933-fbe0-4c2c-9fe4-1890eda36af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:24.464994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:24.466650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:24.468460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:24.468460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:24.468460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:24.468460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:24.468460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 631/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:24.474648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34125bc4-fd71-4ad8-b601-903e886b67bd None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:24.580480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34125bc4-fd71-4ad8-b601-903e886b67bd None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:24.614660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6855026-99e2-4088-950d-ce1607d797a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:24.615411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6855026-99e2-4088-950d-ce1607d797a3 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:24.615778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6855026-99e2-4088-950d-ce1607d797a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:24.616050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6855026-99e2-4088-950d-ce1607d797a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:24.616774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6855026-99e2-4088-950d-ce1607d797a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:24.617077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6855026-99e2-4088-950d-ce1607d797a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:24.618471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6855026-99e2-4088-950d-ce1607d797a3 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:24.632173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 612/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:49:24.638251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5933-fbe0-4c2c-9fe4-1890eda36af3 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:24.741620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5933-fbe0-4c2c-9fe4-1890eda36af3 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:24.779341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72223d3e-e61c-4d2c-a192-5614843fb918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:24.780148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72223d3e-e61c-4d2c-a192-5614843fb918 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:24.780429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72223d3e-e61c-4d2c-a192-5614843fb918 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:24.780699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72223d3e-e61c-4d2c-a192-5614843fb918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:24.788317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72223d3e-e61c-4d2c-a192-5614843fb918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:24.790266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72223d3e-e61c-4d2c-a192-5614843fb918 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-72223d3e-e61c-4d2c-a192-5614843fb918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:49:24.804541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:24.805982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:24.807137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:49:24.807137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:49:24.807137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:49:24.807137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:49:24.807137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:49:24.807137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:49:24.807137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:24.807137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:24.807137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 632/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:49:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:24.812225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6855026-99e2-4088-950d-ce1607d797a3 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:24.920576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6855026-99e2-4088-950d-ce1607d797a3 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:24.956607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a67a0-566d-4a18-8310-5a9902d5276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:24.957263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a67a0-566d-4a18-8310-5a9902d5276e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:24.957567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a67a0-566d-4a18-8310-5a9902d5276e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:24.957853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a67a0-566d-4a18-8310-5a9902d5276e None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:24.958638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a67a0-566d-4a18-8310-5a9902d5276e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:24.958966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a67a0-566d-4a18-8310-5a9902d5276e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:24.960442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a67a0-566d-4a18-8310-5a9902d5276e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:24.972792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 613/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:49:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:24.979846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72223d3e-e61c-4d2c-a192-5614843fb918 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:25.082624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72223d3e-e61c-4d2c-a192-5614843fb918 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:25.114872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482abb6-be66-4552-915a-152c2d80152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:25.115534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482abb6-be66-4552-915a-152c2d80152f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:25.115821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482abb6-be66-4552-915a-152c2d80152f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:25.116096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482abb6-be66-4552-915a-152c2d80152f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:25.116920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482abb6-be66-4552-915a-152c2d80152f None admin] RBAC: Adding query filter params (role.id=4803c7e1a903431faba9ebef03061c0d, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=cf772e34d8f14923bb9c1fe883fd3926) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:25.117230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482abb6-be66-4552-915a-152c2d80152f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:25.118692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482abb6-be66-4552-915a-152c2d80152f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:25.124566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 633/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:49:24 2022] GET /identity/v3/role_assignments?user.id=cf772e34d8f14923bb9c1fe883fd3926&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=4803c7e1a903431faba9ebef03061c0d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:27.748562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd558-6998-4f55-933b-a386093cc0c3 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:27.749224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd558-6998-4f55-933b-a386093cc0c3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:27.749224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd558-6998-4f55-933b-a386093cc0c3 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:27.751024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 614/1247] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:27.757416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df803-fe8a-4600-b35e-a27988365da3 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:27.757877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df803-fe8a-4600-b35e-a27988365da3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:27.758002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df803-fe8a-4600-b35e-a27988365da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:27.777199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-db8df803-fe8a-4600-b35e-a27988365da3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:27.778616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-db8df803-fe8a-4600-b35e-a27988365da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:27.850778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 634/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:49:27.876770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd558-6998-4f55-933b-a386093cc0c3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:27.988281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd558-6998-4f55-933b-a386093cc0c3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:28.028288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbc583-d087-4939-9e9d-8af9574742b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:28.029239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbc583-d087-4939-9e9d-8af9574742b5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:28.029538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbc583-d087-4939-9e9d-8af9574742b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:28.029828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbc583-d087-4939-9e9d-8af9574742b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:28.043650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbc583-d087-4939-9e9d-8af9574742b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-70bbc583-d087-4939-9e9d-8af9574742b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:49:28.052826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:28.054000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:28.058636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 615/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:28.062061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8df803-fe8a-4600-b35e-a27988365da3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:28.169726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8df803-fe8a-4600-b35e-a27988365da3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:28.205296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701ae9e-2f86-47de-8de1-7da2ae8d6957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:28.205983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701ae9e-2f86-47de-8de1-7da2ae8d6957 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:28.206261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701ae9e-2f86-47de-8de1-7da2ae8d6957 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:28.206529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701ae9e-2f86-47de-8de1-7da2ae8d6957 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:28.207262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701ae9e-2f86-47de-8de1-7da2ae8d6957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:28.207565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701ae9e-2f86-47de-8de1-7da2ae8d6957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:28.208920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701ae9e-2f86-47de-8de1-7da2ae8d6957 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:28.218045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 635/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:49:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:28.223923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbc583-d087-4939-9e9d-8af9574742b5 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:28.331018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbc583-d087-4939-9e9d-8af9574742b5 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:28.368258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aecbee-4be0-4aac-92cc-9ddfdce5e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:28.369400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aecbee-4be0-4aac-92cc-9ddfdce5e9de None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:28.369888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aecbee-4be0-4aac-92cc-9ddfdce5e9de None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:28.370155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aecbee-4be0-4aac-92cc-9ddfdce5e9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:28.381939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aecbee-4be0-4aac-92cc-9ddfdce5e9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:28.383406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aecbee-4be0-4aac-92cc-9ddfdce5e9de None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-29aecbee-4be0-4aac-92cc-9ddfdce5e9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:28.401616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:28.402761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:28.403866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:28.403866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:28.403866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:28.403866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:28.403866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 616/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:28.409558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701ae9e-2f86-47de-8de1-7da2ae8d6957 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:28.513789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701ae9e-2f86-47de-8de1-7da2ae8d6957 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:28.552830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5643d1d-8edf-46f1-a000-48d123afceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:28.552830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5643d1d-8edf-46f1-a000-48d123afceb1 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:28.553162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5643d1d-8edf-46f1-a000-48d123afceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:28.553360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5643d1d-8edf-46f1-a000-48d123afceb1 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:28.554105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5643d1d-8edf-46f1-a000-48d123afceb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:28.555306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5643d1d-8edf-46f1-a000-48d123afceb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:28.555816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5643d1d-8edf-46f1-a000-48d123afceb1 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:28.568496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 636/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:28.574132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aecbee-4be0-4aac-92cc-9ddfdce5e9de None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:28.692193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aecbee-4be0-4aac-92cc-9ddfdce5e9de None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:28.726110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf36ac-756f-43f2-942e-813991a37028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:28.726913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf36ac-756f-43f2-942e-813991a37028 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:28.727200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf36ac-756f-43f2-942e-813991a37028 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:28.727479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf36ac-756f-43f2-942e-813991a37028 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:28.736491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf36ac-756f-43f2-942e-813991a37028 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:28.737973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf36ac-756f-43f2-942e-813991a37028 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-00bf36ac-756f-43f2-942e-813991a37028 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:49:28.753975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:28.755676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:28.756888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:28.760592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 617/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:28.761764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5643d1d-8edf-46f1-a000-48d123afceb1 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:28.867053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5643d1d-8edf-46f1-a000-48d123afceb1 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:28.906012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae26328-9cbb-491e-9957-39d21d0b2814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:28.907180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae26328-9cbb-491e-9957-39d21d0b2814 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:28.907446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae26328-9cbb-491e-9957-39d21d0b2814 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:28.907715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae26328-9cbb-491e-9957-39d21d0b2814 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:28.908540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae26328-9cbb-491e-9957-39d21d0b2814 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:28.908842 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae26328-9cbb-491e-9957-39d21d0b2814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:28.910277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae26328-9cbb-491e-9957-39d21d0b2814 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:28.930754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 637/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 12 18:49:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:28.936394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf36ac-756f-43f2-942e-813991a37028 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:29.042005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf36ac-756f-43f2-942e-813991a37028 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:29.075129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3883-7cdd-48d1-bc13-6ede49511851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:29.075770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3883-7cdd-48d1-bc13-6ede49511851 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:29.076054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3883-7cdd-48d1-bc13-6ede49511851 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:29.076329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3883-7cdd-48d1-bc13-6ede49511851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:29.146983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd3883-7cdd-48d1-bc13-6ede49511851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:29.148613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd3883-7cdd-48d1-bc13-6ede49511851 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:29.252657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 618/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:49:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:49:29.258620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae26328-9cbb-491e-9957-39d21d0b2814 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:29.359814 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae26328-9cbb-491e-9957-39d21d0b2814 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:29.393924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f442d-7bbb-4a33-90d5-1900f102a6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:29.394725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f442d-7bbb-4a33-90d5-1900f102a6fb None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:29.395000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f442d-7bbb-4a33-90d5-1900f102a6fb None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:29.395266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f442d-7bbb-4a33-90d5-1900f102a6fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:29.406110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f442d-7bbb-4a33-90d5-1900f102a6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:29.408170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f442d-7bbb-4a33-90d5-1900f102a6fb None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-191f442d-7bbb-4a33-90d5-1900f102a6fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:29.426495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:29.427798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:29.429067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:29.429067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:29.429067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:29.429067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:29.429067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 638/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:29.433428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3883-7cdd-48d1-bc13-6ede49511851 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:29.532910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3883-7cdd-48d1-bc13-6ede49511851 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:29.567828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fda74-57ba-4e40-918d-49a6bfa27618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:29.568497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fda74-57ba-4e40-918d-49a6bfa27618 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:29.568775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fda74-57ba-4e40-918d-49a6bfa27618 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:29.569044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fda74-57ba-4e40-918d-49a6bfa27618 None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:29.569815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fda74-57ba-4e40-918d-49a6bfa27618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:29.570122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fda74-57ba-4e40-918d-49a6bfa27618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:29.571492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fda74-57ba-4e40-918d-49a6bfa27618 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:29.583658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 619/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:29.589186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f442d-7bbb-4a33-90d5-1900f102a6fb None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:29.694670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f442d-7bbb-4a33-90d5-1900f102a6fb None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:29.727549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e98b9-06cb-4691-83f4-45c7846e88e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:29.728331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e98b9-06cb-4691-83f4-45c7846e88e6 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:29.728605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e98b9-06cb-4691-83f4-45c7846e88e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:29.728874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e98b9-06cb-4691-83f4-45c7846e88e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:29.735511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e98b9-06cb-4691-83f4-45c7846e88e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:29.736936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e98b9-06cb-4691-83f4-45c7846e88e6 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-bd0e98b9-06cb-4691-83f4-45c7846e88e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:49:29.750865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:29.752035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:29.753444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:49:29.753444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:49:29.753444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:49:29.753444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:49:29.753444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:49:29.753444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:49:29.753444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:29.753444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:29.753444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 639/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:29.759262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fda74-57ba-4e40-918d-49a6bfa27618 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:29.859129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fda74-57ba-4e40-918d-49a6bfa27618 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:29.891560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8027c7-340b-4d70-85e4-8a70b9be4598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:29.892202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8027c7-340b-4d70-85e4-8a70b9be4598 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:29.892485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8027c7-340b-4d70-85e4-8a70b9be4598 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:29.892762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8027c7-340b-4d70-85e4-8a70b9be4598 None admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:29.893571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8027c7-340b-4d70-85e4-8a70b9be4598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:29.893886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8027c7-340b-4d70-85e4-8a70b9be4598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:29.895342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8027c7-340b-4d70-85e4-8a70b9be4598 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:29.906736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 620/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:29.912700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e98b9-06cb-4691-83f4-45c7846e88e6 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:30.006959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e98b9-06cb-4691-83f4-45c7846e88e6 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:30.037740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd8cbd-9216-470a-9803-e8bef1d38a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:30.038366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd8cbd-9216-470a-9803-e8bef1d38a58 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:30.038653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd8cbd-9216-470a-9803-e8bef1d38a58 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:30.038930 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd8cbd-9216-470a-9803-e8bef1d38a58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:30.040004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd8cbd-9216-470a-9803-e8bef1d38a58 None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=cf772e34d8f14923bb9c1fe883fd3926) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:30.040314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd8cbd-9216-470a-9803-e8bef1d38a58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:30.041815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd8cbd-9216-470a-9803-e8bef1d38a58 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:30.047560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 640/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:49:29 2022] GET /identity/v3/role_assignments?user.id=cf772e34d8f14923bb9c1fe883fd3926&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=d03e020b3fb34446bbf5893b28904483 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:32.221513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5eb32-5117-4bec-91d0-6c59f7651939 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:32.222101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5eb32-5117-4bec-91d0-6c59f7651939 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:32.222101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5eb32-5117-4bec-91d0-6c59f7651939 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:32.223467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 621/1261] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:32.228741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3efb4-8270-43b4-9f0d-f56d9043814d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:32.229171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3efb4-8270-43b4-9f0d-f56d9043814d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:32.229296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3efb4-8270-43b4-9f0d-f56d9043814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:32.246071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7bb3efb4-8270-43b4-9f0d-f56d9043814d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:32.247251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7bb3efb4-8270-43b4-9f0d-f56d9043814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:32.309747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 641/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:49:32.332493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5eb32-5117-4bec-91d0-6c59f7651939 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:32.428459 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5eb32-5117-4bec-91d0-6c59f7651939 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:32.459444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ea15-668b-48fb-a008-b233286d6e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:32.460213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ea15-668b-48fb-a008-b233286d6e04 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:32.460496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ea15-668b-48fb-a008-b233286d6e04 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:32.460771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ea15-668b-48fb-a008-b233286d6e04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:32.470910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ea15-668b-48fb-a008-b233286d6e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-6db4ea15-668b-48fb-a008-b233286d6e04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:49:32.478489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:32.479665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:32.480758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 622/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:49:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:32.485879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3efb4-8270-43b4-9f0d-f56d9043814d None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:32.580478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3efb4-8270-43b4-9f0d-f56d9043814d None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:32.613234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108b6c-e44d-4e43-9388-1f8a0d762523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:32.614093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108b6c-e44d-4e43-9388-1f8a0d762523 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:32.614449 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108b6c-e44d-4e43-9388-1f8a0d762523 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:32.614791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108b6c-e44d-4e43-9388-1f8a0d762523 None admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:32.615681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b108b6c-e44d-4e43-9388-1f8a0d762523 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:32.616097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b108b6c-e44d-4e43-9388-1f8a0d762523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:32.617650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b108b6c-e44d-4e43-9388-1f8a0d762523 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:32.626907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 642/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:49:32.632865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ea15-668b-48fb-a008-b233286d6e04 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:32.731460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ea15-668b-48fb-a008-b233286d6e04 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:32.762429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e92c7-6e74-4a5c-a4a4-cac303ad63ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:32.763205 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e92c7-6e74-4a5c-a4a4-cac303ad63ee None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:32.763481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e92c7-6e74-4a5c-a4a4-cac303ad63ee None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:32.763750 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e92c7-6e74-4a5c-a4a4-cac303ad63ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:32.773599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e92c7-6e74-4a5c-a4a4-cac303ad63ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:32.775023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e92c7-6e74-4a5c-a4a4-cac303ad63ee None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-474e92c7-6e74-4a5c-a4a4-cac303ad63ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:32.791870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:32.792933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:32.793926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:32.793926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:32.793926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:32.793926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:32.793926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 623/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:32.799348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108b6c-e44d-4e43-9388-1f8a0d762523 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:32.894868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108b6c-e44d-4e43-9388-1f8a0d762523 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:32.927612 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aed3a-fb9f-46ed-afd4-6a5c588c4fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:32.928261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aed3a-fb9f-46ed-afd4-6a5c588c4fba None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:32.928539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aed3a-fb9f-46ed-afd4-6a5c588c4fba None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:32.928810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aed3a-fb9f-46ed-afd4-6a5c588c4fba None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:32.929567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199aed3a-fb9f-46ed-afd4-6a5c588c4fba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:32.929877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199aed3a-fb9f-46ed-afd4-6a5c588c4fba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:32.931256 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199aed3a-fb9f-46ed-afd4-6a5c588c4fba None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:32.942329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 643/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:32.947978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e92c7-6e74-4a5c-a4a4-cac303ad63ee None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:33.041932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e92c7-6e74-4a5c-a4a4-cac303ad63ee None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:33.072753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac7161-e99b-4284-9a06-982f490967cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:33.073548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac7161-e99b-4284-9a06-982f490967cf None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:33.073858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac7161-e99b-4284-9a06-982f490967cf None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:33.074134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac7161-e99b-4284-9a06-982f490967cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:33.081705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac7161-e99b-4284-9a06-982f490967cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:33.083127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac7161-e99b-4284-9a06-982f490967cf None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-5fac7161-e99b-4284-9a06-982f490967cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:49:33.097510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:33.098741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:33.100059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 624/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:33.104177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aed3a-fb9f-46ed-afd4-6a5c588c4fba None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:33.198332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aed3a-fb9f-46ed-afd4-6a5c588c4fba None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:33.230077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfa719-3104-4bb0-bef2-ad653203e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:33.230727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa719-3104-4bb0-bef2-ad653203e219 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:33.231004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa719-3104-4bb0-bef2-ad653203e219 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:33.231276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa719-3104-4bb0-bef2-ad653203e219 None admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:33.232093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfa719-3104-4bb0-bef2-ad653203e219 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:33.232396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfa719-3104-4bb0-bef2-ad653203e219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:33.233822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfa719-3104-4bb0-bef2-ad653203e219 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:33.250308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 644/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 12 18:49:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:33.255812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac7161-e99b-4284-9a06-982f490967cf None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:33.348667 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac7161-e99b-4284-9a06-982f490967cf None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:33.379898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489933-366b-4462-b073-218a7690d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:33.380672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489933-366b-4462-b073-218a7690d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:33.380957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489933-366b-4462-b073-218a7690d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:33.381238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489933-366b-4462-b073-218a7690d3c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:33.391835 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6489933-366b-4462-b073-218a7690d3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:33.393263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6489933-366b-4462-b073-218a7690d3c2 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-f6489933-366b-4462-b073-218a7690d3c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:33.409646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:33.410748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:33.411849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:33.411849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:33.411849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:33.411849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:33.411849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 625/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:33.416514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfa719-3104-4bb0-bef2-ad653203e219 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:33.508985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfa719-3104-4bb0-bef2-ad653203e219 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:33.540927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7f02a-1ebe-4003-9fe4-44bf0f8ac12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:33.541615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7f02a-1ebe-4003-9fe4-44bf0f8ac12f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:33.541899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7f02a-1ebe-4003-9fe4-44bf0f8ac12f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:33.542170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7f02a-1ebe-4003-9fe4-44bf0f8ac12f None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:33.542879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7f02a-1ebe-4003-9fe4-44bf0f8ac12f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:33.543184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7f02a-1ebe-4003-9fe4-44bf0f8ac12f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:33.544530 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7f02a-1ebe-4003-9fe4-44bf0f8ac12f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:33.555776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 645/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:33.561081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489933-366b-4462-b073-218a7690d3c2 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:33.666655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489933-366b-4462-b073-218a7690d3c2 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:33.697607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66d2c0-c8f5-471c-b8a1-49f280c0b0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:33.698388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66d2c0-c8f5-471c-b8a1-49f280c0b0b1 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:33.698671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66d2c0-c8f5-471c-b8a1-49f280c0b0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:33.698945 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66d2c0-c8f5-471c-b8a1-49f280c0b0b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:33.705829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66d2c0-c8f5-471c-b8a1-49f280c0b0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:33.707263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66d2c0-c8f5-471c-b8a1-49f280c0b0b1 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-de66d2c0-c8f5-471c-b8a1-49f280c0b0b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:49:33.721551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:33.722597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:33.728232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:49:33.728232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:49:33.728232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:49:33.728232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:49:33.728232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:49:33.728232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:49:33.728232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:33.728232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:33.728232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 626/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:49:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:33.728873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7f02a-1ebe-4003-9fe4-44bf0f8ac12f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:33.831187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7f02a-1ebe-4003-9fe4-44bf0f8ac12f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:33.863013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236c0fa-7183-4e5c-8eb6-54d12847f057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:33.863661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236c0fa-7183-4e5c-8eb6-54d12847f057 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:33.863940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236c0fa-7183-4e5c-8eb6-54d12847f057 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:33.864212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236c0fa-7183-4e5c-8eb6-54d12847f057 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:33.864984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236c0fa-7183-4e5c-8eb6-54d12847f057 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:33.865289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236c0fa-7183-4e5c-8eb6-54d12847f057 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:33.866738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236c0fa-7183-4e5c-8eb6-54d12847f057 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:33.878710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 646/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:49:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:33.885893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66d2c0-c8f5-471c-b8a1-49f280c0b0b1 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:33.979895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66d2c0-c8f5-471c-b8a1-49f280c0b0b1 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:34.011321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6eeea-e70e-41a7-aab1-82739e5e7270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:34.012186 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6eeea-e70e-41a7-aab1-82739e5e7270 None admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:34.012462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6eeea-e70e-41a7-aab1-82739e5e7270 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:34.012732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6eeea-e70e-41a7-aab1-82739e5e7270 None admin] PATH_INFO: `/v3/projects/8193b8e19212476c8674b59794861c32/users/cf772e34d8f14923bb9c1fe883fd3926/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:34.014630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6eeea-e70e-41a7-aab1-82739e5e7270 None admin] RBAC: Authorizing `identity:create_grant(project_id=8193b8e19212476c8674b59794861c32, user_id=cf772e34d8f14923bb9c1fe883fd3926, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:34.016592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6eeea-e70e-41a7-aab1-82739e5e7270 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:34.028703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 627/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 12 18:49:33 2022] PUT /identity/v3/projects/8193b8e19212476c8674b59794861c32/users/cf772e34d8f14923bb9c1fe883fd3926/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:49:36.199544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb06b8-8177-4706-9e45-33f01cb2a6bc None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:36.200150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb06b8-8177-4706-9e45-33f01cb2a6bc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:36.200150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb06b8-8177-4706-9e45-33f01cb2a6bc None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:36.201464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 647/1274] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:36.207440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd654-0e8f-4068-9180-4b6f4bc92973 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:36.207863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd654-0e8f-4068-9180-4b6f4bc92973 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:36.208003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd654-0e8f-4068-9180-4b6f4bc92973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:36.224038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-478dd654-0e8f-4068-9180-4b6f4bc92973 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:36.225242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-478dd654-0e8f-4068-9180-4b6f4bc92973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:36.288504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 628/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:49:36.311685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb06b8-8177-4706-9e45-33f01cb2a6bc None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:36.407906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb06b8-8177-4706-9e45-33f01cb2a6bc None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:36.440262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacd50e-0324-418f-a114-065d1fd4d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:36.441024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacd50e-0324-418f-a114-065d1fd4d49e None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:36.441301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacd50e-0324-418f-a114-065d1fd4d49e None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:36.441595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacd50e-0324-418f-a114-065d1fd4d49e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:36.451024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacd50e-0324-418f-a114-065d1fd4d49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-fbacd50e-0324-418f-a114-065d1fd4d49e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 18:49:36.459042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:36.460159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:36.461221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 648/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 12 18:49:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:36.465919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd654-0e8f-4068-9180-4b6f4bc92973 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:36.558277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd654-0e8f-4068-9180-4b6f4bc92973 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:36.589725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678295a3-419c-4dc1-94bc-6a5763862513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:36.590369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678295a3-419c-4dc1-94bc-6a5763862513 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:36.590647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678295a3-419c-4dc1-94bc-6a5763862513 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:36.590919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678295a3-419c-4dc1-94bc-6a5763862513 None admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:36.591647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678295a3-419c-4dc1-94bc-6a5763862513 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:36.591950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678295a3-419c-4dc1-94bc-6a5763862513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:36.593322 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678295a3-419c-4dc1-94bc-6a5763862513 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:36.601395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 629/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 12 18:49:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:36.607041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacd50e-0324-418f-a114-065d1fd4d49e None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:36.715190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacd50e-0324-418f-a114-065d1fd4d49e None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:36.746350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40532c9-c2a3-4b1d-8d76-871d29448fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:36.747118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40532c9-c2a3-4b1d-8d76-871d29448fec None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:36.747393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40532c9-c2a3-4b1d-8d76-871d29448fec None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:36.747658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40532c9-c2a3-4b1d-8d76-871d29448fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:36.757470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40532c9-c2a3-4b1d-8d76-871d29448fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:36.758931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40532c9-c2a3-4b1d-8d76-871d29448fec None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-b40532c9-c2a3-4b1d-8d76-871d29448fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:36.775413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:36.776430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:36.777453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:36.777453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:36.777453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:36.777453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:36.777453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 649/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:36.782977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678295a3-419c-4dc1-94bc-6a5763862513 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:36.876808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678295a3-419c-4dc1-94bc-6a5763862513 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:36.908514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d506ca-90e3-4306-ae34-650d3038271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:36.909157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d506ca-90e3-4306-ae34-650d3038271b None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:36.909435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d506ca-90e3-4306-ae34-650d3038271b None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:36.909735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d506ca-90e3-4306-ae34-650d3038271b None admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:36.910443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d506ca-90e3-4306-ae34-650d3038271b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:36.910746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d506ca-90e3-4306-ae34-650d3038271b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:36.912105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d506ca-90e3-4306-ae34-650d3038271b None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:36.923313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 630/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:36.928993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40532c9-c2a3-4b1d-8d76-871d29448fec None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:37.022682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40532c9-c2a3-4b1d-8d76-871d29448fec None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:37.053431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a0bc6-63fa-4f16-bff4-c68e8287733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:37.054231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a0bc6-63fa-4f16-bff4-c68e8287733f None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:37.054515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a0bc6-63fa-4f16-bff4-c68e8287733f None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:37.054788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a0bc6-63fa-4f16-bff4-c68e8287733f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:37.061863 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a0bc6-63fa-4f16-bff4-c68e8287733f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:37.063807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a0bc6-63fa-4f16-bff4-c68e8287733f None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-497a0bc6-63fa-4f16-bff4-c68e8287733f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 18:49:37.077477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:37.079273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:37.080507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 650/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:37.084796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d506ca-90e3-4306-ae34-650d3038271b None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:37.177296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d506ca-90e3-4306-ae34-650d3038271b None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:37.210941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36bfc-716a-4b55-966c-2b58abffad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:37.211595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36bfc-716a-4b55-966c-2b58abffad02 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:37.211874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36bfc-716a-4b55-966c-2b58abffad02 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:37.212146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36bfc-716a-4b55-966c-2b58abffad02 None admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:37.212968 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e36bfc-716a-4b55-966c-2b58abffad02 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:37.213268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e36bfc-716a-4b55-966c-2b58abffad02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:37.214713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e36bfc-716a-4b55-966c-2b58abffad02 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:37.230591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 631/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 12 18:49:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:37.236138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a0bc6-63fa-4f16-bff4-c68e8287733f None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:37.329082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a0bc6-63fa-4f16-bff4-c68e8287733f None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:37.359963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b126-ca77-45a5-897e-bc2a3019348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:37.360576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b126-ca77-45a5-897e-bc2a3019348d None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:37.360853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b126-ca77-45a5-897e-bc2a3019348d None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:37.361125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b126-ca77-45a5-897e-bc2a3019348d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:37.423496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714b126-ca77-45a5-897e-bc2a3019348d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:37.424915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714b126-ca77-45a5-897e-bc2a3019348d None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:37.515103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 651/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 12 18:49:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 18:49:37.520591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36bfc-716a-4b55-966c-2b58abffad02 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:37.614553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36bfc-716a-4b55-966c-2b58abffad02 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:37.649635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c13bd-14e2-493e-8c10-6b3fa5433a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:37.650414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c13bd-14e2-493e-8c10-6b3fa5433a68 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:37.650691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c13bd-14e2-493e-8c10-6b3fa5433a68 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:37.650962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c13bd-14e2-493e-8c10-6b3fa5433a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:37.660828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c13bd-14e2-493e-8c10-6b3fa5433a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:37.662277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c13bd-14e2-493e-8c10-6b3fa5433a68 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-592c13bd-14e2-493e-8c10-6b3fa5433a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 18:49:37.679496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:37.680565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:37.681638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 18:49:37.681638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 18:49:37.681638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 18:49:37.681638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:37.681638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 632/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:37.686234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b126-ca77-45a5-897e-bc2a3019348d None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:37.777091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b126-ca77-45a5-897e-bc2a3019348d None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:37.808969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328297db-a957-48f2-8c09-a01334a1cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:37.809648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328297db-a957-48f2-8c09-a01334a1cc91 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:37.809927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328297db-a957-48f2-8c09-a01334a1cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:37.810195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328297db-a957-48f2-8c09-a01334a1cc91 None admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:37.810906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328297db-a957-48f2-8c09-a01334a1cc91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:37.811204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328297db-a957-48f2-8c09-a01334a1cc91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:37.812752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328297db-a957-48f2-8c09-a01334a1cc91 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:37.823453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 652/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 12 18:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:37.828899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c13bd-14e2-493e-8c10-6b3fa5433a68 None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:37.931018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c13bd-14e2-493e-8c10-6b3fa5433a68 None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:37.961871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dfe52-4f4d-4699-b1e7-3edd22f3f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:37.962645 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dfe52-4f4d-4699-b1e7-3edd22f3f28d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:37.962921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dfe52-4f4d-4699-b1e7-3edd22f3f28d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:37.963189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dfe52-4f4d-4699-b1e7-3edd22f3f28d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:37.969986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dfe52-4f4d-4699-b1e7-3edd22f3f28d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:37.971405 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dfe52-4f4d-4699-b1e7-3edd22f3f28d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application [None req-9b0dfe52-4f4d-4699-b1e7-3edd22f3f28d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 18:49:37.984999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application with Lock( May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:37.986076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:37.987181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 18:49:37.987181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 18:49:37.987181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 18:49:37.987181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 18:49:37.987181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 18:49:37.987181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 18:49:37.987181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 18:49:37.987181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: ERROR keystone.server.flask.application May 12 18:49:37.987181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 633/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 12 18:49:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:37.992036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328297db-a957-48f2-8c09-a01334a1cc91 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:38.085301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328297db-a957-48f2-8c09-a01334a1cc91 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:38.116329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a2a8c-235b-4a62-abac-9fa02f8d2cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:38.116967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2a8c-235b-4a62-abac-9fa02f8d2cb0 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:38.117246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2a8c-235b-4a62-abac-9fa02f8d2cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:38.117518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2a8c-235b-4a62-abac-9fa02f8d2cb0 None admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:38.118316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a2a8c-235b-4a62-abac-9fa02f8d2cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:38.118622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a2a8c-235b-4a62-abac-9fa02f8d2cb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:38.120034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a2a8c-235b-4a62-abac-9fa02f8d2cb0 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:38.131515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 653/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 12 18:49:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:38.137365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dfe52-4f4d-4699-b1e7-3edd22f3f28d None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:38.235655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dfe52-4f4d-4699-b1e7-3edd22f3f28d None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:38.268349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc2b65-1446-42d6-96df-feba122c329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:38.269022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc2b65-1446-42d6-96df-feba122c329d None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:38.269300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc2b65-1446-42d6-96df-feba122c329d None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:38.269599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc2b65-1446-42d6-96df-feba122c329d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:38.270414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc2b65-1446-42d6-96df-feba122c329d None admin] RBAC: Adding query filter params (role.id=d03e020b3fb34446bbf5893b28904483, scope.project.id=8193b8e19212476c8674b59794861c32, user.id=cf772e34d8f14923bb9c1fe883fd3926) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:38.270721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc2b65-1446-42d6-96df-feba122c329d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:38.272130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc2b65-1446-42d6-96df-feba122c329d None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:38.277651 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 634/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 12 18:49:38 2022] GET /identity/v3/role_assignments?user.id=cf772e34d8f14923bb9c1fe883fd3926&scope.project.id=8193b8e19212476c8674b59794861c32&role.id=d03e020b3fb34446bbf5893b28904483 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:40.473989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d61732-44d7-47df-91cd-7652499b0a7f None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:40.474526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d61732-44d7-47df-91cd-7652499b0a7f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:40.474526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d61732-44d7-47df-91cd-7652499b0a7f None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:40.475897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 654/1288] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:40.480991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f421b5e-9e37-455b-bff9-ffa0b8a2791b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:40.481363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f421b5e-9e37-455b-bff9-ffa0b8a2791b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:40.481582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f421b5e-9e37-455b-bff9-ffa0b8a2791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:40.500397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7f421b5e-9e37-455b-bff9-ffa0b8a2791b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:40.501653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7f421b5e-9e37-455b-bff9-ffa0b8a2791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:40.564671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 635/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:49:40.586174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d61732-44d7-47df-91cd-7652499b0a7f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:40.689640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d61732-44d7-47df-91cd-7652499b0a7f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:40.721323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966746ef-7cfb-4e99-b1a0-1baac7e1631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:40.722129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966746ef-7cfb-4e99-b1a0-1baac7e1631a None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:40.722406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966746ef-7cfb-4e99-b1a0-1baac7e1631a None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:40.722674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966746ef-7cfb-4e99-b1a0-1baac7e1631a None admin] PATH_INFO: `/v3/services/placement` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:40.723325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966746ef-7cfb-4e99-b1a0-1baac7e1631a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:40.724729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966746ef-7cfb-4e99-b1a0-1baac7e1631a None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-966746ef-7cfb-4e99-b1a0-1baac7e1631a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:40.736620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:40.737801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:40.739051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 655/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:49:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:40.743871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f421b5e-9e37-455b-bff9-ffa0b8a2791b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:40.835019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f421b5e-9e37-455b-bff9-ffa0b8a2791b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:40.867775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f9e0e-aae4-4bdf-b774-35ccba3fb32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:40.868415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f9e0e-aae4-4bdf-b774-35ccba3fb32c None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:40.868697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f9e0e-aae4-4bdf-b774-35ccba3fb32c None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:40.868978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f9e0e-aae4-4bdf-b774-35ccba3fb32c None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:40.869713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f9e0e-aae4-4bdf-b774-35ccba3fb32c None admin] RBAC: Adding query filter params (name=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:40.870020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f9e0e-aae4-4bdf-b774-35ccba3fb32c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:40.871362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f9e0e-aae4-4bdf-b774-35ccba3fb32c None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:40.875911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 636/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 12 18:49:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:40.883150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966746ef-7cfb-4e99-b1a0-1baac7e1631a None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:40.977224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966746ef-7cfb-4e99-b1a0-1baac7e1631a None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:41.008438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ffbb6-210d-4844-8a34-bf94b928ffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:41.009084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ffbb6-210d-4844-8a34-bf94b928ffbc None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:41.009364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ffbb6-210d-4844-8a34-bf94b928ffbc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:41.009672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ffbb6-210d-4844-8a34-bf94b928ffbc None admin] PATH_INFO: `/v3/services` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:41.010363 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ffbb6-210d-4844-8a34-bf94b928ffbc None admin] RBAC: Adding query filter params (type=placement) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:41.010665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ffbb6-210d-4844-8a34-bf94b928ffbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:41.012015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ffbb6-210d-4844-8a34-bf94b928ffbc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:41.016218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 656/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 12 18:49:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:43.181565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6b3a-31a1-4e76-9c84-f6d0eccacd1f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:43.182085 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6b3a-31a1-4e76-9c84-f6d0eccacd1f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:43.182179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6b3a-31a1-4e76-9c84-f6d0eccacd1f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:43.183505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 637/1293] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:43.188760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad475-8553-48a2-be3f-68e9a6c199bf None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:43.189164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad475-8553-48a2-be3f-68e9a6c199bf None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:43.189302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad475-8553-48a2-be3f-68e9a6c199bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:43.205251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-ee1ad475-8553-48a2-be3f-68e9a6c199bf None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:43.206467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ee1ad475-8553-48a2-be3f-68e9a6c199bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:43.267857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 657/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:49:43.290549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6b3a-31a1-4e76-9c84-f6d0eccacd1f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:43.384864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6b3a-31a1-4e76-9c84-f6d0eccacd1f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:43.416641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b4331-fbf8-4fb8-bc48-8d2638088ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:43.417285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b4331-fbf8-4fb8-bc48-8d2638088ebc None admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:43.417587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b4331-fbf8-4fb8-bc48-8d2638088ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:43.417861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b4331-fbf8-4fb8-bc48-8d2638088ebc None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:43.418567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b4331-fbf8-4fb8-bc48-8d2638088ebc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:43.419908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b4331-fbf8-4fb8-bc48-8d2638088ebc None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:43.432085 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 638/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 12 18:49:43 2022] POST /identity/v3/services => generated 246 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:49:45.640405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2caaf0-c8f0-4888-a6df-b331f125e648 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:45.641138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2caaf0-c8f0-4888-a6df-b331f125e648 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:45.641138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2caaf0-c8f0-4888-a6df-b331f125e648 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:45.642336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 658/1296] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:45.648641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7f10a-fe6c-4c10-8c7c-0efd66e8218a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:45.649170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7f10a-fe6c-4c10-8c7c-0efd66e8218a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:45.649291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7f10a-fe6c-4c10-8c7c-0efd66e8218a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:45.669743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-37c7f10a-fe6c-4c10-8c7c-0efd66e8218a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:45.671205 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-37c7f10a-fe6c-4c10-8c7c-0efd66e8218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:45.738884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 639/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 18:49:45.761189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2caaf0-c8f0-4888-a6df-b331f125e648 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:45.855992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2caaf0-c8f0-4888-a6df-b331f125e648 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:45.887297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7389a1-c07d-4b9c-bbf7-69987968eb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:45.888063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7389a1-c07d-4b9c-bbf7-69987968eb36 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:45.888339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7389a1-c07d-4b9c-bbf7-69987968eb36 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:45.888607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7389a1-c07d-4b9c-bbf7-69987968eb36 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:45.889245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7389a1-c07d-4b9c-bbf7-69987968eb36 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:45.891193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7389a1-c07d-4b9c-bbf7-69987968eb36 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-7f7389a1-c07d-4b9c-bbf7-69987968eb36 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:45.902468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:45.903628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:45.904841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 659/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:49:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:45.910006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7f10a-fe6c-4c10-8c7c-0efd66e8218a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:46.023381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7f10a-fe6c-4c10-8c7c-0efd66e8218a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:46.055052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446508-c62e-4652-a11f-f6db41a6c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:46.055698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446508-c62e-4652-a11f-f6db41a6c96e None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:46.055977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446508-c62e-4652-a11f-f6db41a6c96e None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:46.056249 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446508-c62e-4652-a11f-f6db41a6c96e None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:46.056980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1446508-c62e-4652-a11f-f6db41a6c96e None admin] RBAC: Adding query filter params (name=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:46.057286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1446508-c62e-4652-a11f-f6db41a6c96e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:46.058698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1446508-c62e-4652-a11f-f6db41a6c96e None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:46.064077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 640/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 12 18:49:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:46.069988 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7389a1-c07d-4b9c-bbf7-69987968eb36 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:46.162731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7389a1-c07d-4b9c-bbf7-69987968eb36 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:46.194001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58771f-739c-4094-98ea-114bab5d61dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:46.194642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58771f-739c-4094-98ea-114bab5d61dc None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:46.194919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58771f-739c-4094-98ea-114bab5d61dc None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:46.195189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58771f-739c-4094-98ea-114bab5d61dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:46.195960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58771f-739c-4094-98ea-114bab5d61dc None admin] RBAC: Adding query filter params (interface=public, service_id=612287079a6b4d74862ab2cdb90eaaaa, region_id=RegionOne) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:46.196265 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58771f-739c-4094-98ea-114bab5d61dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:46.197630 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58771f-739c-4094-98ea-114bab5d61dc None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:46.203102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 660/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 12 18:49:46 2022] GET /identity/v3/endpoints?service_id=612287079a6b4d74862ab2cdb90eaaaa&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:49:46.208548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446508-c62e-4652-a11f-f6db41a6c96e None admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:46.303265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446508-c62e-4652-a11f-f6db41a6c96e None admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:46.334463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193bfbb-3782-4f30-9da3-0484ba149240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:46.335116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193bfbb-3782-4f30-9da3-0484ba149240 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:46.335401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193bfbb-3782-4f30-9da3-0484ba149240 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:46.335681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193bfbb-3782-4f30-9da3-0484ba149240 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:46.336361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193bfbb-3782-4f30-9da3-0484ba149240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:46.337749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193bfbb-3782-4f30-9da3-0484ba149240 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:46.344869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 641/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 12 18:49:46 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 18:49:48.520393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d2e39-7399-4594-a411-042adb7fb291 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:48.520984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d2e39-7399-4594-a411-042adb7fb291 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:48.520984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d2e39-7399-4594-a411-042adb7fb291 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:48.522326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 661/1302] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:49:48.527601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da58f-7cf1-4aab-a7f1-7823776f9e7f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:48.528038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da58f-7cf1-4aab-a7f1-7823776f9e7f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:48.528159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da58f-7cf1-4aab-a7f1-7823776f9e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:48.544504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5c8da58f-7cf1-4aab-a7f1-7823776f9e7f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:49:48.546185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5c8da58f-7cf1-4aab-a7f1-7823776f9e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:49:48.608497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 642/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:49:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 18:49:48.631448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d2e39-7399-4594-a411-042adb7fb291 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:48.725868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d2e39-7399-4594-a411-042adb7fb291 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:48.757451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cd40-3148-4a07-94b1-89da8e2b5d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:48.758243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cd40-3148-4a07-94b1-89da8e2b5d35 None admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:48.758523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cd40-3148-4a07-94b1-89da8e2b5d35 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:48.758795 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cd40-3148-4a07-94b1-89da8e2b5d35 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:48.759433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8cd40-3148-4a07-94b1-89da8e2b5d35 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:48.760785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8cd40-3148-4a07-94b1-89da8e2b5d35 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application [None req-3ec8cd40-3148-4a07-94b1-89da8e2b5d35 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 18:49:48.772216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 18:49:48.773391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.get_or_create( May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application with Lock( May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self._enter() May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application return self.creator() May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application created_value = creator( May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: ERROR keystone.server.flask.application May 12 18:49:48.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 662/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 12 18:49:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 18:49:48.779342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8da58f-7cf1-4aab-a7f1-7823776f9e7f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:48.871093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8da58f-7cf1-4aab-a7f1-7823776f9e7f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:48.903191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c05f5e-7b16-4dec-94e4-2219e84bbfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:48.903834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05f5e-7b16-4dec-94e4-2219e84bbfb5 None admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:48.904112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05f5e-7b16-4dec-94e4-2219e84bbfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:48.904382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05f5e-7b16-4dec-94e4-2219e84bbfb5 None admin] PATH_INFO: `/v3/services` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:48.905597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c05f5e-7b16-4dec-94e4-2219e84bbfb5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:49:48.905903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c05f5e-7b16-4dec-94e4-2219e84bbfb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:48.907246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c05f5e-7b16-4dec-94e4-2219e84bbfb5 None admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:48.912079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 643/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 12 18:49:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:49:48.917770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cd40-3148-4a07-94b1-89da8e2b5d35 None admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:49:49.011475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cd40-3148-4a07-94b1-89da8e2b5d35 None admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:49:49.043278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402744a-a573-4b3e-ba7d-10ea1d26d093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:49:49.043851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402744a-a573-4b3e-ba7d-10ea1d26d093 None admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:49:49.044127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402744a-a573-4b3e-ba7d-10ea1d26d093 None admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:49:49.044394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402744a-a573-4b3e-ba7d-10ea1d26d093 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:49:49.045116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402744a-a573-4b3e-ba7d-10ea1d26d093 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:49:49.046488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402744a-a573-4b3e-ba7d-10ea1d26d093 None admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:49:49.064134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 663/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 12 18:49:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:50:52.326098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7471-06ea-4cbd-b39c-1b012308636e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:52.327136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7471-06ea-4cbd-b39c-1b012308636e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:52.327631 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7471-06ea-4cbd-b39c-1b012308636e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:52.335606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371878f-2c6b-48b1-b9d4-fd5f3d8e8aa7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:52.336455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371878f-2c6b-48b1-b9d4-fd5f3d8e8aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:52.336999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371878f-2c6b-48b1-b9d4-fd5f3d8e8aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:52.340951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 644/1307] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:50:52 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:50:52.413341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1371878f-2c6b-48b1-b9d4-fd5f3d8e8aa7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:50:52.415519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1371878f-2c6b-48b1-b9d4-fd5f3d8e8aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:52.555417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 664/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:50:52.610192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382b21c-10c5-4e33-80dc-2d3c0a452e2c None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:52.611617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382b21c-10c5-4e33-80dc-2d3c0a452e2c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:52.613033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382b21c-10c5-4e33-80dc-2d3c0a452e2c None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:52.616133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 645/1309] 10.222.0.48 () {54 vars in 964 bytes} [Thu May 12 18:50:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:50:52.623897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff0ac7-e855-4387-8466-844b0b778fe4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:52.624426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff0ac7-e855-4387-8466-844b0b778fe4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:52.624913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff0ac7-e855-4387-8466-844b0b778fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:52.743161 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-0fff0ac7-e855-4387-8466-844b0b778fe4 None None] MFA Rules not processed for user `41938583e61a45398e3e284c70204292`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:50:52.744630 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0fff0ac7-e855-4387-8466-844b0b778fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:52.864148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 665/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Thu May 12 18:50:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:50:52.873246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382b21c-10c5-4e33-80dc-2d3c0a452e2c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:50:52.875312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5382b21c-10c5-4e33-80dc-2d3c0a452e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:53.045119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382b21c-10c5-4e33-80dc-2d3c0a452e2c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:50:53.136582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0986bd-4ecc-4041-b684-bbce1eda97c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:50:53.137239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0986bd-4ecc-4041-b684-bbce1eda97c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:53.137813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0986bd-4ecc-4041-b684-bbce1eda97c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:53.138096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0986bd-4ecc-4041-b684-bbce1eda97c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:53.139756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-eb0986bd-4ecc-4041-b684-bbce1eda97c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:53.260844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0986bd-4ecc-4041-b684-bbce1eda97c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:50:53.262253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0986bd-4ecc-4041-b684-bbce1eda97c8 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:50:53.281917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 646/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:50:55.888507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717bf8c-b6dc-48c4-ba5e-966ce55f5a9f None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:55.889065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717bf8c-b6dc-48c4-ba5e-966ce55f5a9f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:55.889065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717bf8c-b6dc-48c4-ba5e-966ce55f5a9f None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:55.890451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 666/1312] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:50:55.895733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230851c-e5a8-44a6-8e81-9dd364dcef51 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:55.896181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230851c-e5a8-44a6-8e81-9dd364dcef51 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:55.896498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230851c-e5a8-44a6-8e81-9dd364dcef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:55.979730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c230851c-e5a8-44a6-8e81-9dd364dcef51 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:50:55.980957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c230851c-e5a8-44a6-8e81-9dd364dcef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:56.074329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 647/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:50:56.111974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717bf8c-b6dc-48c4-ba5e-966ce55f5a9f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:50:56.113645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7717bf8c-b6dc-48c4-ba5e-966ce55f5a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:56.216717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717bf8c-b6dc-48c4-ba5e-966ce55f5a9f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:50:56.287858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7766e-cfd0-4a98-beb7-1072fea35957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:50:56.288502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7766e-cfd0-4a98-beb7-1072fea35957 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:56.288786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7766e-cfd0-4a98-beb7-1072fea35957 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:56.289058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7766e-cfd0-4a98-beb7-1072fea35957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:56.291280 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-14e7766e-cfd0-4a98-beb7-1072fea35957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:56.395872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7766e-cfd0-4a98-beb7-1072fea35957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:50:56.397310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7766e-cfd0-4a98-beb7-1072fea35957 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:50:56.416589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 667/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:50:58.935692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f54ca-1bc7-4bfd-b9db-080c94449a12 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:58.936259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f54ca-1bc7-4bfd-b9db-080c94449a12 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:58.936259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f54ca-1bc7-4bfd-b9db-080c94449a12 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:58.937654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 648/1315] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:50:58.942722 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668fa65-3e46-499b-82c6-7b0213710fb2 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:58.943134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668fa65-3e46-499b-82c6-7b0213710fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:58.943277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668fa65-3e46-499b-82c6-7b0213710fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:59.013182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d668fa65-3e46-499b-82c6-7b0213710fb2 None None] MFA Rules not processed for user `dcc5667f58514c749c19bbe4de82923c`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:50:59.014438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d668fa65-3e46-499b-82c6-7b0213710fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:59.105984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 668/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:50:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:50:59.145428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f54ca-1bc7-4bfd-b9db-080c94449a12 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:50:59.147017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-325f54ca-1bc7-4bfd-b9db-080c94449a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:59.246379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f54ca-1bc7-4bfd-b9db-080c94449a12 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:50:59.316113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d6d40-ddce-4c56-9248-147632a55fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:50:59.316745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d6d40-ddce-4c56-9248-147632a55fef service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:50:59.317023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d6d40-ddce-4c56-9248-147632a55fef service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:50:59.317293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d6d40-ddce-4c56-9248-147632a55fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:50:59.318935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-631d6d40-ddce-4c56-9248-147632a55fef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:50:59.422001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d6d40-ddce-4c56-9248-147632a55fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:50:59.423420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d6d40-ddce-4c56-9248-147632a55fef service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:50:59.440934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 649/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:50:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:02.165385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fff5e-5991-4a53-8d15-972d6ebf541e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:02.165943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fff5e-5991-4a53-8d15-972d6ebf541e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:02.166041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fff5e-5991-4a53-8d15-972d6ebf541e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:02.167340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 669/1318] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:02.172834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a0b55-85bb-4c0c-bbf6-4ccfb44e13a3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:02.173233 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a0b55-85bb-4c0c-bbf6-4ccfb44e13a3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:02.173386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a0b55-85bb-4c0c-bbf6-4ccfb44e13a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:02.235995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-721a0b55-85bb-4c0c-bbf6-4ccfb44e13a3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:02.237206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-721a0b55-85bb-4c0c-bbf6-4ccfb44e13a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:02.328285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 650/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:02.380015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18f9a-86bd-4b49-b639-8b561588b95b None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:02.380228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18f9a-86bd-4b49-b639-8b561588b95b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:02.380507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18f9a-86bd-4b49-b639-8b561588b95b None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:02.381922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 670/1320] 10.222.0.48 () {54 vars in 964 bytes} [Thu May 12 18:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:02.387531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2650-5c86-4463-a280-399594959c6a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:02.387851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2650-5c86-4463-a280-399594959c6a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:02.388134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2650-5c86-4463-a280-399594959c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:02.466567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7ced2650-5c86-4463-a280-399594959c6a None None] MFA Rules not processed for user `41938583e61a45398e3e284c70204292`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:02.467787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7ced2650-5c86-4463-a280-399594959c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:02.540082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 651/1321] 10.222.0.48 () {58 vars in 1061 bytes} [Thu May 12 18:51:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:02.549164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18f9a-86bd-4b49-b639-8b561588b95b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:02.550713 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d2a18f9a-86bd-4b49-b639-8b561588b95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:02.648249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18f9a-86bd-4b49-b639-8b561588b95b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:02.717387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6f9da-c7ad-409d-8828-bbd059500b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:02.718049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6f9da-c7ad-409d-8828-bbd059500b0e service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:02.718639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6f9da-c7ad-409d-8828-bbd059500b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:02.718930 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6f9da-c7ad-409d-8828-bbd059500b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:02.720538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5ce6f9da-c7ad-409d-8828-bbd059500b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:02.823656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6f9da-c7ad-409d-8828-bbd059500b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:02.825078 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6f9da-c7ad-409d-8828-bbd059500b0e service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:02.842511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 671/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:06.160850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90ba2c-1f27-48a6-994b-ba8914c0623a None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:06.161340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90ba2c-1f27-48a6-994b-ba8914c0623a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:06.161454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90ba2c-1f27-48a6-994b-ba8914c0623a None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:06.162789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 652/1323] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:06.168130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f740eeb-72fc-4d94-a802-3836d810b37a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:06.168581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f740eeb-72fc-4d94-a802-3836d810b37a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:06.168671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f740eeb-72fc-4d94-a802-3836d810b37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:06.230540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-8f740eeb-72fc-4d94-a802-3836d810b37a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:06.231748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8f740eeb-72fc-4d94-a802-3836d810b37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:06.325414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 672/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:51:06.360876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90ba2c-1f27-48a6-994b-ba8914c0623a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:06.362500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0f90ba2c-1f27-48a6-994b-ba8914c0623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:06.462054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90ba2c-1f27-48a6-994b-ba8914c0623a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:06.531279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270576a5-dca4-4cbb-bd7c-1cde3bfae645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:06.531919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270576a5-dca4-4cbb-bd7c-1cde3bfae645 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:06.532196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270576a5-dca4-4cbb-bd7c-1cde3bfae645 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:06.532464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270576a5-dca4-4cbb-bd7c-1cde3bfae645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:06.534367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-270576a5-dca4-4cbb-bd7c-1cde3bfae645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:06.637962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270576a5-dca4-4cbb-bd7c-1cde3bfae645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:06.639390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270576a5-dca4-4cbb-bd7c-1cde3bfae645 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:06.658106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 653/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:08.916582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932ec4-4d22-42a7-add6-7e6e2daf0b71 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:08.917125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932ec4-4d22-42a7-add6-7e6e2daf0b71 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:08.917125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932ec4-4d22-42a7-add6-7e6e2daf0b71 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:08.918534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 673/1326] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:08.923705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43f5e6-3f74-4133-bae4-dffbd0682fc7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:08.924118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43f5e6-3f74-4133-bae4-dffbd0682fc7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:08.924287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43f5e6-3f74-4133-bae4-dffbd0682fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:08.988224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1b43f5e6-3f74-4133-bae4-dffbd0682fc7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:08.989499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1b43f5e6-3f74-4133-bae4-dffbd0682fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:09.083143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 654/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:09.119150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932ec4-4d22-42a7-add6-7e6e2daf0b71 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:09.120926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f2932ec4-4d22-42a7-add6-7e6e2daf0b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:09.230149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932ec4-4d22-42a7-add6-7e6e2daf0b71 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:09.300606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427848d2-b230-4ff3-93b1-b1cb00bf60b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:09.301249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427848d2-b230-4ff3-93b1-b1cb00bf60b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:09.301544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427848d2-b230-4ff3-93b1-b1cb00bf60b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:09.301833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427848d2-b230-4ff3-93b1-b1cb00bf60b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:09.303450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-427848d2-b230-4ff3-93b1-b1cb00bf60b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:09.411305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427848d2-b230-4ff3-93b1-b1cb00bf60b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:09.412734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427848d2-b230-4ff3-93b1-b1cb00bf60b8 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:09.430434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 674/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:51:11.719509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b792ff-2dd5-4d9d-811e-8cc897d279c0 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:11.720070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b792ff-2dd5-4d9d-811e-8cc897d279c0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:11.720162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b792ff-2dd5-4d9d-811e-8cc897d279c0 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:11.721467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 655/1329] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:11.726968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ebd6d-592b-44b2-b4d8-aed8af629435 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:11.727392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ebd6d-592b-44b2-b4d8-aed8af629435 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:11.727520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ebd6d-592b-44b2-b4d8-aed8af629435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:11.790756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-629ebd6d-592b-44b2-b4d8-aed8af629435 None None] MFA Rules not processed for user `dcc5667f58514c749c19bbe4de82923c`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:11.791952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-629ebd6d-592b-44b2-b4d8-aed8af629435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:11.884567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 675/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:11.921356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b792ff-2dd5-4d9d-811e-8cc897d279c0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:11.922935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c2b792ff-2dd5-4d9d-811e-8cc897d279c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:12.026711 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b792ff-2dd5-4d9d-811e-8cc897d279c0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:12.097553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558605c6-b81d-4de8-bc03-436cad26f438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:12.098437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558605c6-b81d-4de8-bc03-436cad26f438 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:12.098707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558605c6-b81d-4de8-bc03-436cad26f438 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:12.098980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558605c6-b81d-4de8-bc03-436cad26f438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:12.100609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-558605c6-b81d-4de8-bc03-436cad26f438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:12.206597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558605c6-b81d-4de8-bc03-436cad26f438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:12.208029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558605c6-b81d-4de8-bc03-436cad26f438 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:12.226954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 656/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:51:14.670207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2a99c-267b-41ec-84c2-2bc01503fc2f None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:14.671279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2a99c-267b-41ec-84c2-2bc01503fc2f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:14.671882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2a99c-267b-41ec-84c2-2bc01503fc2f None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:14.673480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 676/1332] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:51:14.679189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4d31-9c77-440a-b92b-71c1653e6239 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:14.679668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4d31-9c77-440a-b92b-71c1653e6239 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:14.679764 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4d31-9c77-440a-b92b-71c1653e6239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:14.749146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-04cc4d31-9c77-440a-b92b-71c1653e6239 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:14.750412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-04cc4d31-9c77-440a-b92b-71c1653e6239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:14.845728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 657/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:14.879687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2a99c-267b-41ec-84c2-2bc01503fc2f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:14.881211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-77d2a99c-267b-41ec-84c2-2bc01503fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:14.982521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2a99c-267b-41ec-84c2-2bc01503fc2f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:15.053427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f84b5-7d5c-4801-983b-5d1a2ebebea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:15.054098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f84b5-7d5c-4801-983b-5d1a2ebebea2 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:15.054375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f84b5-7d5c-4801-983b-5d1a2ebebea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:15.054646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f84b5-7d5c-4801-983b-5d1a2ebebea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:15.056252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-827f84b5-7d5c-4801-983b-5d1a2ebebea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:15.162060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f84b5-7d5c-4801-983b-5d1a2ebebea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:15.163556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f84b5-7d5c-4801-983b-5d1a2ebebea2 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:15.181422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 677/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:17.445237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f626cb-08be-4235-afeb-79f4cc8be6fd None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:17.445808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f626cb-08be-4235-afeb-79f4cc8be6fd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:17.445808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f626cb-08be-4235-afeb-79f4cc8be6fd None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:17.447180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 658/1335] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:17.452468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e573b10-95fa-4c07-872f-a6ba9ef76a3b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:17.452887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e573b10-95fa-4c07-872f-a6ba9ef76a3b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:17.453030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e573b10-95fa-4c07-872f-a6ba9ef76a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:17.515067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2e573b10-95fa-4c07-872f-a6ba9ef76a3b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:17.516251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2e573b10-95fa-4c07-872f-a6ba9ef76a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:17.608967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 678/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:17.648682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f626cb-08be-4235-afeb-79f4cc8be6fd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:17.650313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-32f626cb-08be-4235-afeb-79f4cc8be6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:17.750608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f626cb-08be-4235-afeb-79f4cc8be6fd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:17.821758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3cef4-33ba-4699-b225-21e77787645e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:17.822398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3cef4-33ba-4699-b225-21e77787645e service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:17.822674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3cef4-33ba-4699-b225-21e77787645e service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:17.822945 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3cef4-33ba-4699-b225-21e77787645e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:17.824569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ffc3cef4-33ba-4699-b225-21e77787645e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:17.927703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3cef4-33ba-4699-b225-21e77787645e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:17.929139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3cef4-33ba-4699-b225-21e77787645e service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:17.947494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 659/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:51:20.439677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea346a4-b191-424f-9955-6fbeb4d47606 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:20.440220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea346a4-b191-424f-9955-6fbeb4d47606 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:20.440220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea346a4-b191-424f-9955-6fbeb4d47606 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:20.441639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 679/1338] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:20.446679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce104bf3-0498-44c5-8c9b-a4f1e99c8522 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:20.447068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce104bf3-0498-44c5-8c9b-a4f1e99c8522 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:20.447232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce104bf3-0498-44c5-8c9b-a4f1e99c8522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:20.509441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ce104bf3-0498-44c5-8c9b-a4f1e99c8522 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:20.510670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ce104bf3-0498-44c5-8c9b-a4f1e99c8522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:20.604290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 660/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:20.639786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea346a4-b191-424f-9955-6fbeb4d47606 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:20.641412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bea346a4-b191-424f-9955-6fbeb4d47606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:20.739608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea346a4-b191-424f-9955-6fbeb4d47606 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:20.811101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadd3d1-af3e-4bdf-a4df-e29c4c8ed9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:20.811747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadd3d1-af3e-4bdf-a4df-e29c4c8ed9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:20.812100 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadd3d1-af3e-4bdf-a4df-e29c4c8ed9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:20.812382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadd3d1-af3e-4bdf-a4df-e29c4c8ed9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:20.814067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6dadd3d1-af3e-4bdf-a4df-e29c4c8ed9a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:20.921046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadd3d1-af3e-4bdf-a4df-e29c4c8ed9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:20.922497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadd3d1-af3e-4bdf-a4df-e29c4c8ed9a8 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:20.940045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 680/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:25.281739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371724b-a527-479a-a676-c12c25dbfae1 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:25.282280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371724b-a527-479a-a676-c12c25dbfae1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:25.282377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371724b-a527-479a-a676-c12c25dbfae1 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:25.283947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 661/1341] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:25.289908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1ca12-b73f-4ca9-9a24-12d8d8b008b6 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:25.290345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1ca12-b73f-4ca9-9a24-12d8d8b008b6 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:25.290465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1ca12-b73f-4ca9-9a24-12d8d8b008b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:25.358307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-eee1ca12-b73f-4ca9-9a24-12d8d8b008b6 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:25.359527 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-eee1ca12-b73f-4ca9-9a24-12d8d8b008b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:25.458214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 681/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:25.496785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371724b-a527-479a-a676-c12c25dbfae1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:25.498992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f371724b-a527-479a-a676-c12c25dbfae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:25.598927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371724b-a527-479a-a676-c12c25dbfae1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:25.603152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a15db0-7f12-4c4f-84e1-320a7956dce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:25.603796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a15db0-7f12-4c4f-84e1-320a7956dce4 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:25.604079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a15db0-7f12-4c4f-84e1-320a7956dce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:25.604354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a15db0-7f12-4c4f-84e1-320a7956dce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:25.613297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a15db0-7f12-4c4f-84e1-320a7956dce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:25.614762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a15db0-7f12-4c4f-84e1-320a7956dce4 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:25.624713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 662/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:28.421808 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea982b-e3ee-4467-8c2d-2f94db7d60bc None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:28.422312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea982b-e3ee-4467-8c2d-2f94db7d60bc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:28.422312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea982b-e3ee-4467-8c2d-2f94db7d60bc None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:28.423651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 682/1344] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:28.428902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f2683-d267-4e9e-9d56-23d850f6ac5c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:28.429332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f2683-d267-4e9e-9d56-23d850f6ac5c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:28.429465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f2683-d267-4e9e-9d56-23d850f6ac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:28.456470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-714f2683-d267-4e9e-9d56-23d850f6ac5c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:28.457651 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-714f2683-d267-4e9e-9d56-23d850f6ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:28.531168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 663/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:28.567338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea982b-e3ee-4467-8c2d-2f94db7d60bc None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:28.578141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea982b-e3ee-4467-8c2d-2f94db7d60bc None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:28.581572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a89113-edfb-4473-958b-68ca643718f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:28.582201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a89113-edfb-4473-958b-68ca643718f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:28.582481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a89113-edfb-4473-958b-68ca643718f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:28.582752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a89113-edfb-4473-958b-68ca643718f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:28.592200 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a89113-edfb-4473-958b-68ca643718f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:28.593641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a89113-edfb-4473-958b-68ca643718f8 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:28.603070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 683/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:32.846471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a09d50-b904-4266-879d-0aedf8931208 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:32.846962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a09d50-b904-4266-879d-0aedf8931208 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:32.847057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a09d50-b904-4266-879d-0aedf8931208 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:32.848401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 664/1347] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:32.853734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a655e-f764-44cf-b832-f64c9d6d14cb None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:32.854163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a655e-f764-44cf-b832-f64c9d6d14cb None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:32.854325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a655e-f764-44cf-b832-f64c9d6d14cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:32.871511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e40a655e-f764-44cf-b832-f64c9d6d14cb None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:32.872680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e40a655e-f764-44cf-b832-f64c9d6d14cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:32.880987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 684/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:32.919870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a09d50-b904-4266-879d-0aedf8931208 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:32.921662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-21a09d50-b904-4266-879d-0aedf8931208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:32.934660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a09d50-b904-4266-879d-0aedf8931208 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:32.938246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05011817-f404-45ce-a3df-97d73b3be60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:32.938945 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05011817-f404-45ce-a3df-97d73b3be60e service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:32.939289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05011817-f404-45ce-a3df-97d73b3be60e service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:32.939567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05011817-f404-45ce-a3df-97d73b3be60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:32.948990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05011817-f404-45ce-a3df-97d73b3be60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:32.950763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05011817-f404-45ce-a3df-97d73b3be60e service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:32.960094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 665/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:38.292305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8209-aedc-4b22-a450-abae3601a763 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:38.294119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8209-aedc-4b22-a450-abae3601a763 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:38.294558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8209-aedc-4b22-a450-abae3601a763 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:38.296434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 685/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 18:51:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:38.301311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbde8a-5c4c-471b-8bc2-9c658db19b11 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:38.302130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbde8a-5c4c-471b-8bc2-9c658db19b11 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:38.302589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbde8a-5c4c-471b-8bc2-9c658db19b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:38.463216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fdfbde8a-5c4c-471b-8bc2-9c658db19b11 None None] MFA Rules not processed for user `cf772e34d8f14923bb9c1fe883fd3926`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:38.464634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fdfbde8a-5c4c-471b-8bc2-9c658db19b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:38.579617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 666/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 18:51:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:51:42.675962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffb7e4-3790-42ed-82c4-3a8ee843bb96 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:42.676472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffb7e4-3790-42ed-82c4-3a8ee843bb96 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:42.676472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffb7e4-3790-42ed-82c4-3a8ee843bb96 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:42.678024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 686/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 18:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:42.683338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6b4b3-1dca-4d17-abac-4831b8279f20 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:42.684175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6b4b3-1dca-4d17-abac-4831b8279f20 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:42.684725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6b4b3-1dca-4d17-abac-4831b8279f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:42.703865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c6e6b4b3-1dca-4d17-abac-4831b8279f20 None None] MFA Rules not processed for user `cf772e34d8f14923bb9c1fe883fd3926`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:42.705047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c6e6b4b3-1dca-4d17-abac-4831b8279f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:42.714247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 667/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:44.284924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90eda29-4558-4ff1-a8bc-6b5748a26887 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:44.286013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90eda29-4558-4ff1-a8bc-6b5748a26887 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:44.286013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90eda29-4558-4ff1-a8bc-6b5748a26887 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:44.287542 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 687/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 18:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:44.292244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5b72f-2747-449c-aaf3-079cbf2a8a92 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:44.292661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5b72f-2747-449c-aaf3-079cbf2a8a92 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:44.292942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5b72f-2747-449c-aaf3-079cbf2a8a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:44.311277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-43b5b72f-2747-449c-aaf3-079cbf2a8a92 None None] MFA Rules not processed for user `cf772e34d8f14923bb9c1fe883fd3926`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:44.312586 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-43b5b72f-2747-449c-aaf3-079cbf2a8a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:44.321125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 668/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:51:48.255108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f74a7-1a1d-4e8e-8d97-9a6d5b42bbec None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:48.255662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f74a7-1a1d-4e8e-8d97-9a6d5b42bbec None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:48.255662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f74a7-1a1d-4e8e-8d97-9a6d5b42bbec None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:48.257180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 688/1356] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:48.262340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa2f3-6def-4d29-bca3-b859a8ccf685 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:48.263201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa2f3-6def-4d29-bca3-b859a8ccf685 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:48.263711 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa2f3-6def-4d29-bca3-b859a8ccf685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:48.282244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-29daa2f3-6def-4d29-bca3-b859a8ccf685 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:48.283674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-29daa2f3-6def-4d29-bca3-b859a8ccf685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:48.291656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 669/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:51:48.339459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0518fb3-1994-41d2-b25d-deeeafedff0a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:48.339973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0518fb3-1994-41d2-b25d-deeeafedff0a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:48.340444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0518fb3-1994-41d2-b25d-deeeafedff0a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:48.342069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 689/1358] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 12 18:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:48.347680 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5b43-318d-4a36-841c-79b20895e704 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:48.348072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5b43-318d-4a36-841c-79b20895e704 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:48.348455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5b43-318d-4a36-841c-79b20895e704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:48.400132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4b2c5b43-318d-4a36-841c-79b20895e704 None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:48.401332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4b2c5b43-318d-4a36-841c-79b20895e704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:48.479913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 670/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 12 18:51:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:48.490765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0518fb3-1994-41d2-b25d-deeeafedff0a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:48.506556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0518fb3-1994-41d2-b25d-deeeafedff0a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:48.512511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0838f39-37d9-4f40-95c4-76eb9a968403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:48.513215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0838f39-37d9-4f40-95c4-76eb9a968403 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:48.513596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0838f39-37d9-4f40-95c4-76eb9a968403 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:48.513937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0838f39-37d9-4f40-95c4-76eb9a968403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:48.522926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0838f39-37d9-4f40-95c4-76eb9a968403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:48.524607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0838f39-37d9-4f40-95c4-76eb9a968403 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:48.536208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 690/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:50.981086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb1e3-675a-4f8a-b7e2-ef774a15257e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:50.981972 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb1e3-675a-4f8a-b7e2-ef774a15257e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:50.982251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb1e3-675a-4f8a-b7e2-ef774a15257e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:50.983616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 671/1361] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:50.988966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e775969-5547-4c62-b8cf-82cdfa36f1cc None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:50.989379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e775969-5547-4c62-b8cf-82cdfa36f1cc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:50.989604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e775969-5547-4c62-b8cf-82cdfa36f1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:51.007540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9e775969-5547-4c62-b8cf-82cdfa36f1cc None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:51.008646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9e775969-5547-4c62-b8cf-82cdfa36f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:51.016602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 691/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:51.059999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffb1e3-675a-4f8a-b7e2-ef774a15257e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:51.076180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffb1e3-675a-4f8a-b7e2-ef774a15257e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:51.085740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d675e-f1f5-4068-bb6c-96b64c93b701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:51.086608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d675e-f1f5-4068-bb6c-96b64c93b701 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:51.086893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d675e-f1f5-4068-bb6c-96b64c93b701 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:51.087164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d675e-f1f5-4068-bb6c-96b64c93b701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:51.095866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d675e-f1f5-4068-bb6c-96b64c93b701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:51.097447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d675e-f1f5-4068-bb6c-96b64c93b701 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:51.106917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 672/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:53.689485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c32b14-3a9d-4d4a-afe1-ab41de0b573a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:53.690035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c32b14-3a9d-4d4a-afe1-ab41de0b573a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:53.690160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c32b14-3a9d-4d4a-afe1-ab41de0b573a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:53.691618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 692/1364] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:53.697052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c475234-934a-4edd-bcdc-0741ad8d968d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:53.697895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c475234-934a-4edd-bcdc-0741ad8d968d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:53.698380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c475234-934a-4edd-bcdc-0741ad8d968d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:53.716811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0c475234-934a-4edd-bcdc-0741ad8d968d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:53.718306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0c475234-934a-4edd-bcdc-0741ad8d968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:53.728113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 673/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:53.781028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4bb5-3476-486f-8b9e-21ad78018423 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:53.781226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4bb5-3476-486f-8b9e-21ad78018423 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:53.781486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4bb5-3476-486f-8b9e-21ad78018423 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:53.783226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 693/1366] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 12 18:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:53.790362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea8682-abda-45b9-a988-7d178dd68fdf None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:53.790657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea8682-abda-45b9-a988-7d178dd68fdf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:53.790933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea8682-abda-45b9-a988-7d178dd68fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:53.809718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-19ea8682-abda-45b9-a988-7d178dd68fdf None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:53.810898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-19ea8682-abda-45b9-a988-7d178dd68fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:53.820482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 674/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 12 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:53.828193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d4bb5-3476-486f-8b9e-21ad78018423 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:53.843207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d4bb5-3476-486f-8b9e-21ad78018423 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:53.848752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f109d4-8643-493d-9761-e7d5d4f7d538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:53.849549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f109d4-8643-493d-9761-e7d5d4f7d538 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:53.849961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f109d4-8643-493d-9761-e7d5d4f7d538 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:53.850245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f109d4-8643-493d-9761-e7d5d4f7d538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:53.858305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f109d4-8643-493d-9761-e7d5d4f7d538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:53.860096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f109d4-8643-493d-9761-e7d5d4f7d538 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:53.872226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 694/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:56.200755 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78b591-6a86-4f37-9d56-dfebf78860ee None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:56.201329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78b591-6a86-4f37-9d56-dfebf78860ee None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:56.201329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78b591-6a86-4f37-9d56-dfebf78860ee None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:56.207514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 675/1369] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:56.209408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b837a1-7fea-4183-a0d3-3f6dbe2938d5 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:56.209871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b837a1-7fea-4183-a0d3-3f6dbe2938d5 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:56.210048 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b837a1-7fea-4183-a0d3-3f6dbe2938d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:56.229282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-28b837a1-7fea-4183-a0d3-3f6dbe2938d5 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:56.230720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-28b837a1-7fea-4183-a0d3-3f6dbe2938d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:56.239136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 695/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:56.283520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78b591-6a86-4f37-9d56-dfebf78860ee None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:56.298878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78b591-6a86-4f37-9d56-dfebf78860ee None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:56.305700 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab000d-25ed-4593-9047-f11bef13b50f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:56.306766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab000d-25ed-4593-9047-f11bef13b50f service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:56.307257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab000d-25ed-4593-9047-f11bef13b50f service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:56.307761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab000d-25ed-4593-9047-f11bef13b50f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:56.317725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab000d-25ed-4593-9047-f11bef13b50f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:56.319443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab000d-25ed-4593-9047-f11bef13b50f service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:56.330353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 676/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:56.503047 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daa412-ba9a-4000-b48a-5a21024bb26a None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:56.503438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daa412-ba9a-4000-b48a-5a21024bb26a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:56.503617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daa412-ba9a-4000-b48a-5a21024bb26a None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:56.505357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 696/1372] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:56.511357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510300a-b380-4a99-81e5-485070e47ad0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:56.511713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510300a-b380-4a99-81e5-485070e47ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:56.511913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510300a-b380-4a99-81e5-485070e47ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:56.531008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8510300a-b380-4a99-81e5-485070e47ad0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:56.532915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8510300a-b380-4a99-81e5-485070e47ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:56.549556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 677/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:56.852609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c93f3-3309-4f90-8521-e7dba6bd1ea3 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:56.852609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c93f3-3309-4f90-8521-e7dba6bd1ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:56.852609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c93f3-3309-4f90-8521-e7dba6bd1ea3 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:56.855589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 697/1374] 10.222.0.48 () {54 vars in 963 bytes} [Thu May 12 18:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:56.858641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9594d-e3b8-4639-b5de-17e583c7a15e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:56.858857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9594d-e3b8-4639-b5de-17e583c7a15e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:56.859133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9594d-e3b8-4639-b5de-17e583c7a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:56.908539 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-20b9594d-e3b8-4639-b5de-17e583c7a15e None None] MFA Rules not processed for user `c25d2d15ebf644b889ab453d1b7ed277`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:56.910004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-20b9594d-e3b8-4639-b5de-17e583c7a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:56.969753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 678/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Thu May 12 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:56.977730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c93f3-3309-4f90-8521-e7dba6bd1ea3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:56.988275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c93f3-3309-4f90-8521-e7dba6bd1ea3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:56.991991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a0c50-586b-4bc8-a8e9-a8186e829b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:56.992731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0c50-586b-4bc8-a8e9-a8186e829b29 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:56.993116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0c50-586b-4bc8-a8e9-a8186e829b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:56.993494 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0c50-586b-4bc8-a8e9-a8186e829b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:57.002935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a0c50-586b-4bc8-a8e9-a8186e829b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:57.005020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a0c50-586b-4bc8-a8e9-a8186e829b29 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:57.014732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 698/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:51:58.608197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605ec3-6f89-49e9-a2ce-932513099ecc None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:58.608797 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605ec3-6f89-49e9-a2ce-932513099ecc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:58.608797 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605ec3-6f89-49e9-a2ce-932513099ecc None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:58.610211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 679/1377] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:51:58.616675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dfa84-db8e-4f50-9a67-b55f3f7be074 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:58.617204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dfa84-db8e-4f50-9a67-b55f3f7be074 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:58.617297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dfa84-db8e-4f50-9a67-b55f3f7be074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:58.635452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6b2dfa84-db8e-4f50-9a67-b55f3f7be074 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:51:58.636961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6b2dfa84-db8e-4f50-9a67-b55f3f7be074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:51:58.646365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 699/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:51:58.691879 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605ec3-6f89-49e9-a2ce-932513099ecc None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:51:58.706578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605ec3-6f89-49e9-a2ce-932513099ecc None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:51:58.712778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110b05b-3471-48a0-9007-53d28b1e030a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:51:58.713425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110b05b-3471-48a0-9007-53d28b1e030a service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:51:58.713745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110b05b-3471-48a0-9007-53d28b1e030a service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:51:58.714029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110b05b-3471-48a0-9007-53d28b1e030a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:51:58.722627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110b05b-3471-48a0-9007-53d28b1e030a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:51:58.724790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110b05b-3471-48a0-9007-53d28b1e030a service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:51:58.734441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 680/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:00.994985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22347190-3557-4fe3-aef8-ac72d0a26874 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:00.995893 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22347190-3557-4fe3-aef8-ac72d0a26874 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:00.996176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22347190-3557-4fe3-aef8-ac72d0a26874 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:00.997561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 700/1380] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:01.002697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264f6f-0514-435a-a342-a173041d073c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:01.003129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264f6f-0514-435a-a342-a173041d073c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:01.003256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264f6f-0514-435a-a342-a173041d073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:01.021226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b2264f6f-0514-435a-a342-a173041d073c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:01.022555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b2264f6f-0514-435a-a342-a173041d073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:01.030600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 681/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:01.074574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22347190-3557-4fe3-aef8-ac72d0a26874 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:01.088817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22347190-3557-4fe3-aef8-ac72d0a26874 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:01.094253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d16b12-0515-4b63-b312-5b9ec8168cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:01.094989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16b12-0515-4b63-b312-5b9ec8168cbd service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:01.095388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16b12-0515-4b63-b312-5b9ec8168cbd service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:01.095788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16b12-0515-4b63-b312-5b9ec8168cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:01.104691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d16b12-0515-4b63-b312-5b9ec8168cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:01.106447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d16b12-0515-4b63-b312-5b9ec8168cbd service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:01.117446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 701/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:03.368654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60f00c-b388-4371-b935-c42acedbe9b1 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:03.369181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60f00c-b388-4371-b935-c42acedbe9b1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:03.369181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60f00c-b388-4371-b935-c42acedbe9b1 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:03.370538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 682/1383] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:03.376073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce1c25-cadb-42e8-af6c-d260be7773bd None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:03.376560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce1c25-cadb-42e8-af6c-d260be7773bd None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:03.376642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce1c25-cadb-42e8-af6c-d260be7773bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:03.396338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6fce1c25-cadb-42e8-af6c-d260be7773bd None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:03.397683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6fce1c25-cadb-42e8-af6c-d260be7773bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:03.406068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 702/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:03.449516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60f00c-b388-4371-b935-c42acedbe9b1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:03.464633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60f00c-b388-4371-b935-c42acedbe9b1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:03.470289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb603790-b59e-44da-b6fa-aadfbe623c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:03.471067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb603790-b59e-44da-b6fa-aadfbe623c03 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:03.471453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb603790-b59e-44da-b6fa-aadfbe623c03 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:03.471829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb603790-b59e-44da-b6fa-aadfbe623c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:03.480865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb603790-b59e-44da-b6fa-aadfbe623c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:03.482571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb603790-b59e-44da-b6fa-aadfbe623c03 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:03.492425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 683/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:05.751894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae8cd-6d5f-4fe2-bad2-bfd80833ed28 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:05.752491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae8cd-6d5f-4fe2-bad2-bfd80833ed28 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:05.752680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae8cd-6d5f-4fe2-bad2-bfd80833ed28 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:05.754492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 703/1386] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:05.760747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9b0d-d213-48a6-8209-d23b5f7aabd6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:05.761197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9b0d-d213-48a6-8209-d23b5f7aabd6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:05.761312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9b0d-d213-48a6-8209-d23b5f7aabd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:05.779980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-71cd9b0d-d213-48a6-8209-d23b5f7aabd6 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:05.781200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-71cd9b0d-d213-48a6-8209-d23b5f7aabd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:05.790292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 684/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:05.847362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae8cd-6d5f-4fe2-bad2-bfd80833ed28 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:05.863925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae8cd-6d5f-4fe2-bad2-bfd80833ed28 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:05.869462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7018a9-748e-48ca-8b3c-d75919a888a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:05.870129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7018a9-748e-48ca-8b3c-d75919a888a0 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:05.870414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7018a9-748e-48ca-8b3c-d75919a888a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:05.870689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7018a9-748e-48ca-8b3c-d75919a888a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:05.879148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7018a9-748e-48ca-8b3c-d75919a888a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:05.881336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7018a9-748e-48ca-8b3c-d75919a888a0 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:05.890987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 704/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:08.148498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ecf5-74a3-48be-8ec4-128ca121fff0 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:08.149013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ecf5-74a3-48be-8ec4-128ca121fff0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:08.149130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ecf5-74a3-48be-8ec4-128ca121fff0 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:08.150480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 685/1389] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:08.156237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f6ac-47cf-4f02-8c59-4a1d37111f8e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:08.156692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f6ac-47cf-4f02-8c59-4a1d37111f8e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:08.156948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f6ac-47cf-4f02-8c59-4a1d37111f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:08.178883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-bcd0f6ac-47cf-4f02-8c59-4a1d37111f8e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:08.180075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bcd0f6ac-47cf-4f02-8c59-4a1d37111f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:08.188360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 705/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:08.233266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4ecf5-74a3-48be-8ec4-128ca121fff0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:08.248248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4ecf5-74a3-48be-8ec4-128ca121fff0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:08.253873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53ccdb-cdf4-49f4-85cf-5540e1c79712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:08.254518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53ccdb-cdf4-49f4-85cf-5540e1c79712 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:08.254804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53ccdb-cdf4-49f4-85cf-5540e1c79712 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:08.255131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53ccdb-cdf4-49f4-85cf-5540e1c79712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:08.263695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53ccdb-cdf4-49f4-85cf-5540e1c79712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:08.265339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53ccdb-cdf4-49f4-85cf-5540e1c79712 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:08.275349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 686/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:10.877105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3cdc-ee4c-4846-b36d-f318bd9f3d63 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:10.877798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3cdc-ee4c-4846-b36d-f318bd9f3d63 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:10.877798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3cdc-ee4c-4846-b36d-f318bd9f3d63 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:10.879231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 706/1392] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:10.884446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71aae-7599-4c8d-87bb-83e402f369f3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:10.884880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71aae-7599-4c8d-87bb-83e402f369f3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:10.885008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71aae-7599-4c8d-87bb-83e402f369f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:10.903501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-97e71aae-7599-4c8d-87bb-83e402f369f3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:10.904678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-97e71aae-7599-4c8d-87bb-83e402f369f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:10.913557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 687/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:10.956736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e3cdc-ee4c-4846-b36d-f318bd9f3d63 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:10.971843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e3cdc-ee4c-4846-b36d-f318bd9f3d63 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:10.977901 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04db9fb-1b0c-4225-9cf0-7dab53dc3d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:10.978534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04db9fb-1b0c-4225-9cf0-7dab53dc3d72 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:10.978816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04db9fb-1b0c-4225-9cf0-7dab53dc3d72 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:10.979088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04db9fb-1b0c-4225-9cf0-7dab53dc3d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:10.987256 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04db9fb-1b0c-4225-9cf0-7dab53dc3d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:10.988961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04db9fb-1b0c-4225-9cf0-7dab53dc3d72 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:10.998235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 707/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:12.651388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc8a2e-9302-483d-af1a-ea9a368bd9c8 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:12.651997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc8a2e-9302-483d-af1a-ea9a368bd9c8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:12.651997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc8a2e-9302-483d-af1a-ea9a368bd9c8 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:12.653397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 688/1395] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:12.659134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4bbf3-6c94-48b8-afde-20dd788fb384 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:12.659561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4bbf3-6c94-48b8-afde-20dd788fb384 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:12.659695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4bbf3-6c94-48b8-afde-20dd788fb384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:12.676892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-48e4bbf3-6c94-48b8-afde-20dd788fb384 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:12.678119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-48e4bbf3-6c94-48b8-afde-20dd788fb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:12.685849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 708/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:12.741884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7bdd-744f-4931-bdfb-685ec77bfd9e None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:12.742175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7bdd-744f-4931-bdfb-685ec77bfd9e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:12.742455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7bdd-744f-4931-bdfb-685ec77bfd9e None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:12.743863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 689/1397] 10.222.0.48 () {54 vars in 962 bytes} [Thu May 12 18:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:12.749063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edd6ea-c71f-480d-9575-92e6b072b2cc None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:12.749355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edd6ea-c71f-480d-9575-92e6b072b2cc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:12.749664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edd6ea-c71f-480d-9575-92e6b072b2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:12.797120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-96edd6ea-c71f-480d-9575-92e6b072b2cc None None] MFA Rules not processed for user `066d62c015e9483e87e4bd64ce8c4df7`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:12.798345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-96edd6ea-c71f-480d-9575-92e6b072b2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:12.855313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 709/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Thu May 12 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:12.862714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7bdd-744f-4931-bdfb-685ec77bfd9e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:12.873227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7bdd-744f-4931-bdfb-685ec77bfd9e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:12.876787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066cb47-892d-4e3d-a192-2517ed86d706 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066d62c015e9483e87e4bd64ce8c4df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:12.877428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066cb47-892d-4e3d-a192-2517ed86d706 service glance] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:12.877757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066cb47-892d-4e3d-a192-2517ed86d706 service glance] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:12.878030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066cb47-892d-4e3d-a192-2517ed86d706 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:12.887510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066cb47-892d-4e3d-a192-2517ed86d706 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:12.888970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066cb47-892d-4e3d-a192-2517ed86d706 service glance] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:12.898803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 690/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:13.224088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d3d45-3e0e-47ed-8474-aa3cc21604f8 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:13.224373 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d3d45-3e0e-47ed-8474-aa3cc21604f8 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:13.224647 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d3d45-3e0e-47ed-8474-aa3cc21604f8 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:13.226079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 710/1400] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:13.231416 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fe0f6-0bcd-415d-9f2e-d99d6189fbf4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:13.231647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fe0f6-0bcd-415d-9f2e-d99d6189fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:13.231928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fe0f6-0bcd-415d-9f2e-d99d6189fbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:13.249706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9c3fe0f6-0bcd-415d-9f2e-d99d6189fbf4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:13.252295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9c3fe0f6-0bcd-415d-9f2e-d99d6189fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:13.260156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 691/1401] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:13.304539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d3d45-3e0e-47ed-8474-aa3cc21604f8 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:13.315552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996d4d2-c24a-4b50-a397-4c3b369b0e02 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:13.315917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996d4d2-c24a-4b50-a397-4c3b369b0e02 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:13.316274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996d4d2-c24a-4b50-a397-4c3b369b0e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:13.319603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d3d45-3e0e-47ed-8474-aa3cc21604f8 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:13.324901 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62797e-dad9-4c90-94cb-a80e52bd354e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:13.325512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62797e-dad9-4c90-94cb-a80e52bd354e service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:13.325821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62797e-dad9-4c90-94cb-a80e52bd354e service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:13.326093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62797e-dad9-4c90-94cb-a80e52bd354e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:13.334209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62797e-dad9-4c90-94cb-a80e52bd354e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:13.335782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62797e-dad9-4c90-94cb-a80e52bd354e service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:13.345434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 711/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:52:13.366312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9996d4d2-c24a-4b50-a397-4c3b369b0e02 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:13.367522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9996d4d2-c24a-4b50-a397-4c3b369b0e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:13.432310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 692/1403] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:52:13.479987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965956-b96c-4c2e-8aef-4be53fc334be None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:13.480529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965956-b96c-4c2e-8aef-4be53fc334be None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:13.480873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965956-b96c-4c2e-8aef-4be53fc334be None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:13.482488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 712/1404] 10.222.0.48 () {54 vars in 942 bytes} [Thu May 12 18:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:13.490486 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f400-be20-4a77-960e-570ac72516d4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:13.490882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f400-be20-4a77-960e-570ac72516d4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:13.491224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f400-be20-4a77-960e-570ac72516d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:13.543286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7695f400-be20-4a77-960e-570ac72516d4 None None] MFA Rules not processed for user `84eb7224717643288cc61f8e6f901543`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:13.544523 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7695f400-be20-4a77-960e-570ac72516d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:13.615792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 693/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Thu May 12 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:13.625332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f965956-b96c-4c2e-8aef-4be53fc334be None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:13.638908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f965956-b96c-4c2e-8aef-4be53fc334be None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:13.644389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91c7d8-282a-40fc-b593-66602e45129c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:13.645049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91c7d8-282a-40fc-b593-66602e45129c service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:13.645316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91c7d8-282a-40fc-b593-66602e45129c service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:13.645614 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91c7d8-282a-40fc-b593-66602e45129c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:13.654720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91c7d8-282a-40fc-b593-66602e45129c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:13.656295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91c7d8-282a-40fc-b593-66602e45129c service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:13.664693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 713/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 18:52:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 18:52:15.652640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb5b4-2147-415b-8e6f-519a7337e768 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:15.653860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb5b4-2147-415b-8e6f-519a7337e768 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:15.654225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb5b4-2147-415b-8e6f-519a7337e768 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:15.655681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 694/1407] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:15.661128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319adc4-4d34-4915-8d37-0a1e241cef5b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:15.662110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319adc4-4d34-4915-8d37-0a1e241cef5b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:15.662227 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319adc4-4d34-4915-8d37-0a1e241cef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:15.681209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-a319adc4-4d34-4915-8d37-0a1e241cef5b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:15.682459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a319adc4-4d34-4915-8d37-0a1e241cef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:15.690566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 714/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:15.734133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb5b4-2147-415b-8e6f-519a7337e768 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:15.752323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb5b4-2147-415b-8e6f-519a7337e768 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:15.758281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fc96a-9aef-4661-b676-f3ca7e4e5b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:15.759045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fc96a-9aef-4661-b676-f3ca7e4e5b80 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:15.759396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fc96a-9aef-4661-b676-f3ca7e4e5b80 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:15.759738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fc96a-9aef-4661-b676-f3ca7e4e5b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:15.768275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fc96a-9aef-4661-b676-f3ca7e4e5b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:15.769995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fc96a-9aef-4661-b676-f3ca7e4e5b80 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:15.780265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 695/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:37.202450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dda65-f5fa-4e57-b4f6-0b2853e8b922 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:37.203071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dda65-f5fa-4e57-b4f6-0b2853e8b922 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:37.203071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dda65-f5fa-4e57-b4f6-0b2853e8b922 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:37.204376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 715/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu May 12 18:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:37.210240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c34b-2993-4251-be0d-cb5e69110f92 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:37.210759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c34b-2993-4251-be0d-cb5e69110f92 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:37.210885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c34b-2993-4251-be0d-cb5e69110f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:37.228762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6ca6c34b-2993-4251-be0d-cb5e69110f92 None None] MFA Rules not processed for user `cf772e34d8f14923bb9c1fe883fd3926`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:37.229971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6ca6c34b-2993-4251-be0d-cb5e69110f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:37.238163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 696/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 12 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:37.251740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94647d3-7710-4f99-a621-58d412880ff4 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:37.252027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94647d3-7710-4f99-a621-58d412880ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:37.252306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94647d3-7710-4f99-a621-58d412880ff4 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:37.253668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 716/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu May 12 18:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:37.257974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad651181-c6cf-4ae0-933c-926ab94e820c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:37.258260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad651181-c6cf-4ae0-933c-926ab94e820c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:37.258536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad651181-c6cf-4ae0-933c-926ab94e820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:37.275882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ad651181-c6cf-4ae0-933c-926ab94e820c None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:37.277048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ad651181-c6cf-4ae0-933c-926ab94e820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:37.286189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 697/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 12 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:39.951212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9ef97-fe02-4f01-aeb8-ac34d8565f23 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:39.951787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9ef97-fe02-4f01-aeb8-ac34d8565f23 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:39.951787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9ef97-fe02-4f01-aeb8-ac34d8565f23 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:39.953120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:39.958332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a857075-afa1-416a-a3cd-2816a32e0226 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:39.958783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a857075-afa1-416a-a3cd-2816a32e0226 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:39.958899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a857075-afa1-416a-a3cd-2816a32e0226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:39.976346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0a857075-afa1-416a-a3cd-2816a32e0226 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:39.977549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0a857075-afa1-416a-a3cd-2816a32e0226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:39.985314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:52:40.026197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9ef97-fe02-4f01-aeb8-ac34d8565f23 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:40.040464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9ef97-fe02-4f01-aeb8-ac34d8565f23 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:40.045852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114b7e1-dab4-4470-abb0-9f75d7196eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:40.046476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b7e1-dab4-4470-abb0-9f75d7196eca service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:40.046759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b7e1-dab4-4470-abb0-9f75d7196eca service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:40.047034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b7e1-dab4-4470-abb0-9f75d7196eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:40.055454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114b7e1-dab4-4470-abb0-9f75d7196eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:40.057049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114b7e1-dab4-4470-abb0-9f75d7196eca service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:40.066238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 718/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:41.054688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e570-04dd-480a-a6db-cb3b25401bd3 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:41.055260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e570-04dd-480a-a6db-cb3b25401bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:41.055260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e570-04dd-480a-a6db-cb3b25401bd3 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:41.056594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:41.061458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b55e4-5130-4b61-a788-d30b582ab9f6 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:41.061920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b55e4-5130-4b61-a788-d30b582ab9f6 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:41.062037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b55e4-5130-4b61-a788-d30b582ab9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:41.079928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6c0b55e4-5130-4b61-a788-d30b582ab9f6 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:41.081135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6c0b55e4-5130-4b61-a788-d30b582ab9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:41.089361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:41.244978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e570-04dd-480a-a6db-cb3b25401bd3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:41.259122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e570-04dd-480a-a6db-cb3b25401bd3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:41.264409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8557e4-aee9-4469-9b57-433acaccbcd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:41.265035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8557e4-aee9-4469-9b57-433acaccbcd4 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:41.265317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8557e4-aee9-4469-9b57-433acaccbcd4 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:41.265624 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8557e4-aee9-4469-9b57-433acaccbcd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:41.273518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8557e4-aee9-4469-9b57-433acaccbcd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:41.275101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8557e4-aee9-4469-9b57-433acaccbcd4 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:41.284146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 700/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:42.234287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a42d6-23d7-4a65-8f3a-a7e1c5258237 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:42.234712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a42d6-23d7-4a65-8f3a-a7e1c5258237 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:42.234838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a42d6-23d7-4a65-8f3a-a7e1c5258237 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:42.236218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:42.242113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e1fef-31b3-49b4-a0cb-82b862da65e7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:42.242784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e1fef-31b3-49b4-a0cb-82b862da65e7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:42.242784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e1fef-31b3-49b4-a0cb-82b862da65e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:42.261359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-735e1fef-31b3-49b4-a0cb-82b862da65e7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:42.262591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-735e1fef-31b3-49b4-a0cb-82b862da65e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:42.270373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:42.420169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a42d6-23d7-4a65-8f3a-a7e1c5258237 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:42.434648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a42d6-23d7-4a65-8f3a-a7e1c5258237 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:42.439859 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe566e10-48b6-4eb0-a818-68ba4f5f51e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:42.440484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe566e10-48b6-4eb0-a818-68ba4f5f51e5 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:42.440764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe566e10-48b6-4eb0-a818-68ba4f5f51e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:42.441037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe566e10-48b6-4eb0-a818-68ba4f5f51e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:42.449425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe566e10-48b6-4eb0-a818-68ba4f5f51e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:42.451020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe566e10-48b6-4eb0-a818-68ba4f5f51e5 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:42.460077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 721/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:43.371235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a1e8b-d9de-436c-91f6-61fa54d41c1a None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:43.371771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a1e8b-d9de-436c-91f6-61fa54d41c1a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:43.371771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a1e8b-d9de-436c-91f6-61fa54d41c1a None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:43.373143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:43.378015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9de51-8d29-4949-891f-265f63b81485 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:43.378435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9de51-8d29-4949-891f-265f63b81485 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:43.378550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9de51-8d29-4949-891f-265f63b81485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:43.395809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-89b9de51-8d29-4949-891f-265f63b81485 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:43.397023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-89b9de51-8d29-4949-891f-265f63b81485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:43.404653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:43.551434 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a1e8b-d9de-436c-91f6-61fa54d41c1a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:43.565977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a1e8b-d9de-436c-91f6-61fa54d41c1a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:43.571183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad975d4-032e-4c78-b52e-e31c26754303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:43.571802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad975d4-032e-4c78-b52e-e31c26754303 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:43.572080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad975d4-032e-4c78-b52e-e31c26754303 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:43.572352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad975d4-032e-4c78-b52e-e31c26754303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:43.580224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad975d4-032e-4c78-b52e-e31c26754303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:43.581808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad975d4-032e-4c78-b52e-e31c26754303 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:43.590804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 703/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:44.504661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a320da-1c70-4375-817a-7cdb95d1c946 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:44.505229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a320da-1c70-4375-817a-7cdb95d1c946 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:44.505229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a320da-1c70-4375-817a-7cdb95d1c946 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:44.506616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:44.511513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a3cbc-ddc0-4fdd-90e7-b788ebcaf106 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:44.511936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a3cbc-ddc0-4fdd-90e7-b788ebcaf106 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:44.512070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a3cbc-ddc0-4fdd-90e7-b788ebcaf106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:44.530904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fd9a3cbc-ddc0-4fdd-90e7-b788ebcaf106 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:44.532118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fd9a3cbc-ddc0-4fdd-90e7-b788ebcaf106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:44.540686 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:44.687796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a320da-1c70-4375-817a-7cdb95d1c946 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:44.701810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a320da-1c70-4375-817a-7cdb95d1c946 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:44.707119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e879-fa1f-49f8-93ac-4a8018fd931d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:44.707807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e879-fa1f-49f8-93ac-4a8018fd931d service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:44.708086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e879-fa1f-49f8-93ac-4a8018fd931d service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:44.708357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e879-fa1f-49f8-93ac-4a8018fd931d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:44.716929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e879-fa1f-49f8-93ac-4a8018fd931d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:44.718533 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e879-fa1f-49f8-93ac-4a8018fd931d service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:44.728226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 724/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:45.591162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb98c-c767-48e1-bdf7-72f5443bba07 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:45.591749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb98c-c767-48e1-bdf7-72f5443bba07 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:45.591749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb98c-c767-48e1-bdf7-72f5443bba07 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:45.593083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:45.598160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9beea9-aa5d-4048-b6d3-0fd54f092368 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:45.598575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9beea9-aa5d-4048-b6d3-0fd54f092368 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:45.598715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9beea9-aa5d-4048-b6d3-0fd54f092368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:45.617437 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7f9beea9-aa5d-4048-b6d3-0fd54f092368 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:45.618653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7f9beea9-aa5d-4048-b6d3-0fd54f092368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:45.626330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:45.774334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eb98c-c767-48e1-bdf7-72f5443bba07 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:45.788878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eb98c-c767-48e1-bdf7-72f5443bba07 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:45.794150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2c2cb-0ef6-4941-ac38-89a3eb101dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:45.794773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2c2cb-0ef6-4941-ac38-89a3eb101dd4 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:45.795050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2c2cb-0ef6-4941-ac38-89a3eb101dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:45.795318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2c2cb-0ef6-4941-ac38-89a3eb101dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:45.803166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2c2cb-0ef6-4941-ac38-89a3eb101dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:45.805338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2c2cb-0ef6-4941-ac38-89a3eb101dd4 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:45.814391 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 706/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:46.686147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1436f-7096-4a37-9d13-88a87d94a9f3 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:46.686715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1436f-7096-4a37-9d13-88a87d94a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:46.686715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1436f-7096-4a37-9d13-88a87d94a9f3 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:46.688054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:46.693035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce69835-9f93-4656-ba8e-74296237fe50 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:46.693436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce69835-9f93-4656-ba8e-74296237fe50 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:46.693625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce69835-9f93-4656-ba8e-74296237fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:46.711620 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9ce69835-9f93-4656-ba8e-74296237fe50 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:46.712808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9ce69835-9f93-4656-ba8e-74296237fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:46.720481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:46.868804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1436f-7096-4a37-9d13-88a87d94a9f3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:46.882636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1436f-7096-4a37-9d13-88a87d94a9f3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:46.887872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b091e9d-d440-4e65-a430-8eef666e0ee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:46.888495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b091e9d-d440-4e65-a430-8eef666e0ee9 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:46.888776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b091e9d-d440-4e65-a430-8eef666e0ee9 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:46.889051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b091e9d-d440-4e65-a430-8eef666e0ee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:46.897163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b091e9d-d440-4e65-a430-8eef666e0ee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:46.899259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b091e9d-d440-4e65-a430-8eef666e0ee9 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:46.908337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 727/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:47.769749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c062ef-71b5-42ac-ac81-022b448e2c6d None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:47.770363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c062ef-71b5-42ac-ac81-022b448e2c6d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:47.770363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c062ef-71b5-42ac-ac81-022b448e2c6d None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:47.771667 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:47.776591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb0500-813a-40ed-87d7-4e58456bc9fa None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:47.777016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb0500-813a-40ed-87d7-4e58456bc9fa None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:47.777131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb0500-813a-40ed-87d7-4e58456bc9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:47.795189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-a4eb0500-813a-40ed-87d7-4e58456bc9fa None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:47.796369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a4eb0500-813a-40ed-87d7-4e58456bc9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:47.805237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:47.954005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c062ef-71b5-42ac-ac81-022b448e2c6d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:47.968672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c062ef-71b5-42ac-ac81-022b448e2c6d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:47.974088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79311105-d2c8-4775-b8cb-58d40a5bb2db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:47.974718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79311105-d2c8-4775-b8cb-58d40a5bb2db service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:47.975001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79311105-d2c8-4775-b8cb-58d40a5bb2db service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:47.975279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79311105-d2c8-4775-b8cb-58d40a5bb2db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:47.983188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79311105-d2c8-4775-b8cb-58d40a5bb2db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:47.984759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79311105-d2c8-4775-b8cb-58d40a5bb2db service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:47.993928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 709/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:48.864555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b83d9-181a-41ff-93a0-019002b30f99 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:48.865120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b83d9-181a-41ff-93a0-019002b30f99 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:48.865241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b83d9-181a-41ff-93a0-019002b30f99 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:48.866682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:48.872245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62397-9e5b-4b05-86d6-250d8d5c3f9a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:48.872673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62397-9e5b-4b05-86d6-250d8d5c3f9a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:48.872805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62397-9e5b-4b05-86d6-250d8d5c3f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:48.890244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a2b62397-9e5b-4b05-86d6-250d8d5c3f9a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:48.891462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a2b62397-9e5b-4b05-86d6-250d8d5c3f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:48.899641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:49.047586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b83d9-181a-41ff-93a0-019002b30f99 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:49.061479 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b83d9-181a-41ff-93a0-019002b30f99 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:49.066797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a0ab1-e0f4-4c6d-815e-c81ef511e812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:49.067450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a0ab1-e0f4-4c6d-815e-c81ef511e812 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:49.067735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a0ab1-e0f4-4c6d-815e-c81ef511e812 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:49.068012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a0ab1-e0f4-4c6d-815e-c81ef511e812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:49.076800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a0ab1-e0f4-4c6d-815e-c81ef511e812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:49.078403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a0ab1-e0f4-4c6d-815e-c81ef511e812 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:49.088360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 730/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:51.173723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6439-3ba2-4bfa-a81c-be6eb3b5129a None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:51.174268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6439-3ba2-4bfa-a81c-be6eb3b5129a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:51.174268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6439-3ba2-4bfa-a81c-be6eb3b5129a None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:51.175646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:51.181455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90bfa-869a-4b37-aa8b-7b807277ad02 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:51.181919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90bfa-869a-4b37-aa8b-7b807277ad02 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:51.182039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90bfa-869a-4b37-aa8b-7b807277ad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:51.199580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-51a90bfa-869a-4b37-aa8b-7b807277ad02 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:51.200746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-51a90bfa-869a-4b37-aa8b-7b807277ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:51.208811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:51.246735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a6439-3ba2-4bfa-a81c-be6eb3b5129a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:51.257104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a6439-3ba2-4bfa-a81c-be6eb3b5129a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:51.261057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6a7a3-cb31-4ca4-acdd-a233787304fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:51.261715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6a7a3-cb31-4ca4-acdd-a233787304fb service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:51.261999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6a7a3-cb31-4ca4-acdd-a233787304fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:51.262279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6a7a3-cb31-4ca4-acdd-a233787304fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:51.270939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6a7a3-cb31-4ca4-acdd-a233787304fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:51.272306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6a7a3-cb31-4ca4-acdd-a233787304fb service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:51.281330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 712/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:53.643858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3222be-71a6-4d66-93f7-76116380fe33 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:53.644470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3222be-71a6-4d66-93f7-76116380fe33 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:53.644470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3222be-71a6-4d66-93f7-76116380fe33 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:53.645902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:53.651574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146b64-a95b-40cd-8238-e8ca4142d049 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:53.652132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146b64-a95b-40cd-8238-e8ca4142d049 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:53.652132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146b64-a95b-40cd-8238-e8ca4142d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:53.669834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-84146b64-a95b-40cd-8238-e8ca4142d049 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:53.671016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-84146b64-a95b-40cd-8238-e8ca4142d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:53.678590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:53.716079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3222be-71a6-4d66-93f7-76116380fe33 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:53.726450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3222be-71a6-4d66-93f7-76116380fe33 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:53.729873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac85cb-8ea3-4396-ac4a-979322811a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:53.730492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac85cb-8ea3-4396-ac4a-979322811a52 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:53.730770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac85cb-8ea3-4396-ac4a-979322811a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:53.731042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac85cb-8ea3-4396-ac4a-979322811a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:53.739499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac85cb-8ea3-4396-ac4a-979322811a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:53.740908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac85cb-8ea3-4396-ac4a-979322811a52 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:53.750349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 733/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:56.286305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fc429-455c-4299-a542-d07e09499f39 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:56.286809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fc429-455c-4299-a542-d07e09499f39 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:56.287192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fc429-455c-4299-a542-d07e09499f39 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:56.289041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:56.294298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604430b-cc9a-46ee-b4f4-187bf0606683 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:56.294681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604430b-cc9a-46ee-b4f4-187bf0606683 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:56.294861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604430b-cc9a-46ee-b4f4-187bf0606683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:56.312849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-5604430b-cc9a-46ee-b4f4-187bf0606683 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:56.314074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5604430b-cc9a-46ee-b4f4-187bf0606683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:56.321804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:56.359783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fc429-455c-4299-a542-d07e09499f39 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:56.370708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fc429-455c-4299-a542-d07e09499f39 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:56.374174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e6b7-2fd6-476a-910d-1c4f6b3624ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:56.374796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e6b7-2fd6-476a-910d-1c4f6b3624ff service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:56.375080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e6b7-2fd6-476a-910d-1c4f6b3624ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:56.375356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e6b7-2fd6-476a-910d-1c4f6b3624ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:56.384342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897e6b7-2fd6-476a-910d-1c4f6b3624ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:56.385953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897e6b7-2fd6-476a-910d-1c4f6b3624ff service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:56.396464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 715/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:52:58.732023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0e59-0f2c-41f4-86d2-bb98c8e3e720 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:58.732635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0e59-0f2c-41f4-86d2-bb98c8e3e720 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:58.732635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0e59-0f2c-41f4-86d2-bb98c8e3e720 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:58.733978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:52:58.739166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f2a81-e322-45bf-9ff4-1a33954893bc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:58.739616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f2a81-e322-45bf-9ff4-1a33954893bc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:58.739875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f2a81-e322-45bf-9ff4-1a33954893bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:58.758176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-622f2a81-e322-45bf-9ff4-1a33954893bc None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:52:58.759403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-622f2a81-e322-45bf-9ff4-1a33954893bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:52:58.767165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:52:58.804974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0e59-0f2c-41f4-86d2-bb98c8e3e720 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:52:58.815494 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0e59-0f2c-41f4-86d2-bb98c8e3e720 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:52:58.818966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09238cb2-0607-4ae5-8dd8-38488dc50334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:52:58.819593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238cb2-0607-4ae5-8dd8-38488dc50334 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:52:58.819924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238cb2-0607-4ae5-8dd8-38488dc50334 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:52:58.820303 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238cb2-0607-4ae5-8dd8-38488dc50334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:52:58.829451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09238cb2-0607-4ae5-8dd8-38488dc50334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:52:58.830907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09238cb2-0607-4ae5-8dd8-38488dc50334 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:52:58.840213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 736/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:01.081829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48842718-c27b-4072-b6de-f33bb3aa7c26 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:01.082400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48842718-c27b-4072-b6de-f33bb3aa7c26 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:01.082400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48842718-c27b-4072-b6de-f33bb3aa7c26 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:01.083740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:01.088884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6162-0c45-4ad6-ad7f-e2d22b756a37 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:01.089318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6162-0c45-4ad6-ad7f-e2d22b756a37 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:01.089422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6162-0c45-4ad6-ad7f-e2d22b756a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:01.107550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7c8f6162-0c45-4ad6-ad7f-e2d22b756a37 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:01.108723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7c8f6162-0c45-4ad6-ad7f-e2d22b756a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:01.116294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:01.153694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48842718-c27b-4072-b6de-f33bb3aa7c26 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:01.164323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48842718-c27b-4072-b6de-f33bb3aa7c26 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:01.167742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070563-8a62-4b9b-93ef-b0f895f746da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:01.168370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070563-8a62-4b9b-93ef-b0f895f746da service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:01.168650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070563-8a62-4b9b-93ef-b0f895f746da service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:01.168922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070563-8a62-4b9b-93ef-b0f895f746da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:01.177748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7070563-8a62-4b9b-93ef-b0f895f746da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:01.179154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7070563-8a62-4b9b-93ef-b0f895f746da service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:01.188797 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 718/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:03.462244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9826d-55f8-4c0b-9fbd-39d944f34199 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:03.462817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9826d-55f8-4c0b-9fbd-39d944f34199 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:03.462817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9826d-55f8-4c0b-9fbd-39d944f34199 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:03.464169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:03.469476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360e9a-8769-4684-9b90-e847856f5e4e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:03.469946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360e9a-8769-4684-9b90-e847856f5e4e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:03.470060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360e9a-8769-4684-9b90-e847856f5e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:03.487311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ac360e9a-8769-4684-9b90-e847856f5e4e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:03.488496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ac360e9a-8769-4684-9b90-e847856f5e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:03.496718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:53:03.534054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9826d-55f8-4c0b-9fbd-39d944f34199 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:03.545152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9826d-55f8-4c0b-9fbd-39d944f34199 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:03.548631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a5c8-b989-474b-84fa-62b71ed2768e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:03.549249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a5c8-b989-474b-84fa-62b71ed2768e service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:03.549549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a5c8-b989-474b-84fa-62b71ed2768e service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:03.549836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a5c8-b989-474b-84fa-62b71ed2768e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:03.559096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837a5c8-b989-474b-84fa-62b71ed2768e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:03.560522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837a5c8-b989-474b-84fa-62b71ed2768e service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:03.569584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 739/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:05.801876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148e382-a84f-4f1c-bba7-8749bdfa63cd None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:05.802420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148e382-a84f-4f1c-bba7-8749bdfa63cd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:05.802420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148e382-a84f-4f1c-bba7-8749bdfa63cd None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:05.803815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:53:05.809739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cfdd7-b819-4095-8765-c8550191f17d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:05.810168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cfdd7-b819-4095-8765-c8550191f17d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:05.810271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cfdd7-b819-4095-8765-c8550191f17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:05.827224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-aa3cfdd7-b819-4095-8765-c8550191f17d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:05.828388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-aa3cfdd7-b819-4095-8765-c8550191f17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:05.835980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:05.872594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148e382-a84f-4f1c-bba7-8749bdfa63cd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:05.883078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148e382-a84f-4f1c-bba7-8749bdfa63cd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:05.886549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f1a1-4654-47a3-869b-240ab876be27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:05.887175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f1a1-4654-47a3-869b-240ab876be27 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:05.887456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f1a1-4654-47a3-869b-240ab876be27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:05.887731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f1a1-4654-47a3-869b-240ab876be27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:05.896276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9f1a1-4654-47a3-869b-240ab876be27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:05.897731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9f1a1-4654-47a3-869b-240ab876be27 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:05.907053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 721/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:08.160087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c29bac-f025-4af5-aa4a-c72512d89c96 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:08.160550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c29bac-f025-4af5-aa4a-c72512d89c96 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:08.160662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c29bac-f025-4af5-aa4a-c72512d89c96 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:08.162232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:08.168172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1485-fd53-4780-ab09-f25cc6af4a97 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:08.168604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1485-fd53-4780-ab09-f25cc6af4a97 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:08.168720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1485-fd53-4780-ab09-f25cc6af4a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:08.186471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2bfa1485-fd53-4780-ab09-f25cc6af4a97 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:08.187657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2bfa1485-fd53-4780-ab09-f25cc6af4a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:08.195302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:08.231566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c29bac-f025-4af5-aa4a-c72512d89c96 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:08.243071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c29bac-f025-4af5-aa4a-c72512d89c96 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:08.246756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeb73d-8f9f-486b-879f-e144e9ff1c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:08.247395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb73d-8f9f-486b-879f-e144e9ff1c1f service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:08.247677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb73d-8f9f-486b-879f-e144e9ff1c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:08.247951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb73d-8f9f-486b-879f-e144e9ff1c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:08.257064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeb73d-8f9f-486b-879f-e144e9ff1c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:08.258547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeb73d-8f9f-486b-879f-e144e9ff1c1f service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:08.267649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 742/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:10.495058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0edc7-edfe-4b31-8ce6-780da9f84661 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:10.495607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0edc7-edfe-4b31-8ce6-780da9f84661 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:10.495607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0edc7-edfe-4b31-8ce6-780da9f84661 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:10.496965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:10.502182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1961e48-8d26-4dff-8b67-c5a17bb7c78a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:10.502587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1961e48-8d26-4dff-8b67-c5a17bb7c78a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:10.502743 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1961e48-8d26-4dff-8b67-c5a17bb7c78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:10.520931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b1961e48-8d26-4dff-8b67-c5a17bb7c78a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:10.522170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b1961e48-8d26-4dff-8b67-c5a17bb7c78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:10.530539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:10.566734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0edc7-edfe-4b31-8ce6-780da9f84661 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:10.577589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0edc7-edfe-4b31-8ce6-780da9f84661 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:10.580952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b3ea5-e2f5-47b5-8164-48e23b3bab4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:10.581601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b3ea5-e2f5-47b5-8164-48e23b3bab4b service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:10.581882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b3ea5-e2f5-47b5-8164-48e23b3bab4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:10.582158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b3ea5-e2f5-47b5-8164-48e23b3bab4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:10.591334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b3ea5-e2f5-47b5-8164-48e23b3bab4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:10.592743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b3ea5-e2f5-47b5-8164-48e23b3bab4b service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:10.602075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 724/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:12.821416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c412-7812-4e66-9bdb-188d6d11255b None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:12.822032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c412-7812-4e66-9bdb-188d6d11255b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:12.822143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c412-7812-4e66-9bdb-188d6d11255b None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:12.823436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:12.828962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a0b1-0c63-495a-be0f-2f3a0706fac1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:12.829426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a0b1-0c63-495a-be0f-2f3a0706fac1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:12.829560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a0b1-0c63-495a-be0f-2f3a0706fac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:12.847695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4dd0a0b1-0c63-495a-be0f-2f3a0706fac1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:12.848876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4dd0a0b1-0c63-495a-be0f-2f3a0706fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:12.856504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:12.892355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1c412-7812-4e66-9bdb-188d6d11255b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:12.903314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1c412-7812-4e66-9bdb-188d6d11255b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:12.906751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80cae-120e-4787-aa99-9855f66f0c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:12.907369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80cae-120e-4787-aa99-9855f66f0c63 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:12.907642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80cae-120e-4787-aa99-9855f66f0c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:12.907911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80cae-120e-4787-aa99-9855f66f0c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:12.916645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d80cae-120e-4787-aa99-9855f66f0c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:12.918093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d80cae-120e-4787-aa99-9855f66f0c63 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:12.926970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 745/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:45.920946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d216e-c6d2-45b7-8afe-6054d957b03f None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:45.921566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d216e-c6d2-45b7-8afe-6054d957b03f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:45.921566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d216e-c6d2-45b7-8afe-6054d957b03f None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:45.922899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 726/1471] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:45.927920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6c58-2d4a-47e0-872c-43173875c41d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:45.928328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6c58-2d4a-47e0-872c-43173875c41d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:45.928477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6c58-2d4a-47e0-872c-43173875c41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:45.945821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-836a6c58-2d4a-47e0-872c-43173875c41d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:45.947030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-836a6c58-2d4a-47e0-872c-43173875c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:45.954708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 746/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:46.004240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308ee91-a553-4029-9e66-30538453c646 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:46.004531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308ee91-a553-4029-9e66-30538453c646 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:46.004809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308ee91-a553-4029-9e66-30538453c646 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:46.006194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 727/1473] 10.222.0.48 () {54 vars in 962 bytes} [Thu May 12 18:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:46.011170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bcbf-8401-4e44-9dd8-7d5a1e0a0ed0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:46.011538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bcbf-8401-4e44-9dd8-7d5a1e0a0ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:46.011820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bcbf-8401-4e44-9dd8-7d5a1e0a0ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:46.029670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7262bcbf-8401-4e44-9dd8-7d5a1e0a0ed0 None None] MFA Rules not processed for user `066d62c015e9483e87e4bd64ce8c4df7`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:46.030836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7262bcbf-8401-4e44-9dd8-7d5a1e0a0ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:46.037546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 747/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Thu May 12 18:53:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:46.045366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308ee91-a553-4029-9e66-30538453c646 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:46.055553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308ee91-a553-4029-9e66-30538453c646 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:46.058960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddd462-c85b-49a0-acb6-680edce8c65a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066d62c015e9483e87e4bd64ce8c4df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:46.059573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd462-c85b-49a0-acb6-680edce8c65a service glance] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:46.059854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd462-c85b-49a0-acb6-680edce8c65a service glance] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:46.060124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd462-c85b-49a0-acb6-680edce8c65a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:46.068622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddd462-c85b-49a0-acb6-680edce8c65a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:46.070067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddd462-c85b-49a0-acb6-680edce8c65a service glance] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:46.079172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 728/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:48.361747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd678b38-2ae3-4aa2-b5f4-6f21c33b4b4e None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:48.362304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd678b38-2ae3-4aa2-b5f4-6f21c33b4b4e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:48.362781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd678b38-2ae3-4aa2-b5f4-6f21c33b4b4e None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:48.365220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 748/1476] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:53:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:48.370619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa67941-1c60-4fc2-9bbb-2370b3a80a9d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:48.371056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa67941-1c60-4fc2-9bbb-2370b3a80a9d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:48.371174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa67941-1c60-4fc2-9bbb-2370b3a80a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:48.388070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0aa67941-1c60-4fc2-9bbb-2370b3a80a9d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:48.389188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0aa67941-1c60-4fc2-9bbb-2370b3a80a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:48.396740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 729/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:48.420824 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd678b38-2ae3-4aa2-b5f4-6f21c33b4b4e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:48.432981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd678b38-2ae3-4aa2-b5f4-6f21c33b4b4e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:48.437313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ae1d9-e840-450e-9b5e-1b57cb2d41a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:48.437981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae1d9-e840-450e-9b5e-1b57cb2d41a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:48.438263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae1d9-e840-450e-9b5e-1b57cb2d41a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:48.438536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae1d9-e840-450e-9b5e-1b57cb2d41a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:48.439253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ae1d9-e840-450e-9b5e-1b57cb2d41a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:48.441004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING py.warnings [None req-e58ae1d9-e840-450e-9b5e-1b57cb2d41a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:53:48.441004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: warnings.warn(msg) May 12 18:53:48.441004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: May 12 18:53:48.442145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ae1d9-e840-450e-9b5e-1b57cb2d41a2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:48.460496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 749/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 12 18:53:48 2022] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:53:50.681697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a159bd-e0c3-4c9b-9e76-f5d14516af85 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:50.681697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a159bd-e0c3-4c9b-9e76-f5d14516af85 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:50.682784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a159bd-e0c3-4c9b-9e76-f5d14516af85 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:50.683630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 730/1479] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:50.688765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503147ab-5c9a-4fd8-b409-cf5a4c261513 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:50.689172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503147ab-5c9a-4fd8-b409-cf5a4c261513 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:50.689321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503147ab-5c9a-4fd8-b409-cf5a4c261513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:50.707300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-503147ab-5c9a-4fd8-b409-cf5a4c261513 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:50.708480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-503147ab-5c9a-4fd8-b409-cf5a4c261513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:50.716203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 750/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:50.757506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a159bd-e0c3-4c9b-9e76-f5d14516af85 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:50.771865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a159bd-e0c3-4c9b-9e76-f5d14516af85 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:50.779031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90d30b-7def-41b4-8164-a0b68e2365c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:50.779659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90d30b-7def-41b4-8164-a0b68e2365c8 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:50.779937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90d30b-7def-41b4-8164-a0b68e2365c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:50.780207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90d30b-7def-41b4-8164-a0b68e2365c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:50.788163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90d30b-7def-41b4-8164-a0b68e2365c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:50.790290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90d30b-7def-41b4-8164-a0b68e2365c8 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:50.799440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 731/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:53.175672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f35420-bee8-4b07-a204-a69168db5b72 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:53.176194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f35420-bee8-4b07-a204-a69168db5b72 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:53.176194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f35420-bee8-4b07-a204-a69168db5b72 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:53.177571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 751/1482] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:53.183481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517df85-8fe2-4057-9796-4f537b9e580c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:53.183924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517df85-8fe2-4057-9796-4f537b9e580c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:53.184038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517df85-8fe2-4057-9796-4f537b9e580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:53.201066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5517df85-8fe2-4057-9796-4f537b9e580c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:53.202275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5517df85-8fe2-4057-9796-4f537b9e580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:53.209793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 732/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:53.245703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f35420-bee8-4b07-a204-a69168db5b72 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:53.256108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f35420-bee8-4b07-a204-a69168db5b72 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:53.259564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115138d-d779-44dd-b8f8-3603a777a49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:53.260179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115138d-d779-44dd-b8f8-3603a777a49d service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:53.260457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115138d-d779-44dd-b8f8-3603a777a49d service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:53.260726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115138d-d779-44dd-b8f8-3603a777a49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:53.269183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115138d-d779-44dd-b8f8-3603a777a49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:53.270665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115138d-d779-44dd-b8f8-3603a777a49d service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:53.279648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 752/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:55.543303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b3532-8b78-45ed-b0fc-482df48f8115 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:55.543887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b3532-8b78-45ed-b0fc-482df48f8115 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:55.543887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b3532-8b78-45ed-b0fc-482df48f8115 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:55.545268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 733/1485] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:55.550402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdd04c-351d-4cf0-b594-346578e084ee None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:55.550845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdd04c-351d-4cf0-b594-346578e084ee None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:55.550942 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdd04c-351d-4cf0-b594-346578e084ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:55.568768 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d4bdd04c-351d-4cf0-b594-346578e084ee None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:55.570006 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d4bdd04c-351d-4cf0-b594-346578e084ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:55.578325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 753/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:55.616272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b3532-8b78-45ed-b0fc-482df48f8115 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:55.626787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b3532-8b78-45ed-b0fc-482df48f8115 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:55.630294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd82011-3573-43d9-aea7-c691070b631b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:55.630922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82011-3573-43d9-aea7-c691070b631b service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:55.631206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82011-3573-43d9-aea7-c691070b631b service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:55.631484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82011-3573-43d9-aea7-c691070b631b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:55.640592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd82011-3573-43d9-aea7-c691070b631b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:55.642071 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd82011-3573-43d9-aea7-c691070b631b service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:55.652275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 734/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:53:57.960621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83548a-37f7-4001-b2d6-84af54c61625 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:57.961165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83548a-37f7-4001-b2d6-84af54c61625 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:57.961165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83548a-37f7-4001-b2d6-84af54c61625 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:57.963151 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 754/1488] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:53:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:53:57.968536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf09df-6846-4b54-9f54-a2c4f8b1d6dd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:57.968956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf09df-6846-4b54-9f54-a2c4f8b1d6dd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:57.969093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf09df-6846-4b54-9f54-a2c4f8b1d6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:57.986851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-00cf09df-6846-4b54-9f54-a2c4f8b1d6dd None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:53:57.988037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00cf09df-6846-4b54-9f54-a2c4f8b1d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:53:57.996656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 735/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:53:58.035650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83548a-37f7-4001-b2d6-84af54c61625 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:53:58.046718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83548a-37f7-4001-b2d6-84af54c61625 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:53:58.050206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f216f1-e41d-49ce-97e3-c22349fc8e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:53:58.050866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f216f1-e41d-49ce-97e3-c22349fc8e2c service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:53:58.051152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f216f1-e41d-49ce-97e3-c22349fc8e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:53:58.051431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f216f1-e41d-49ce-97e3-c22349fc8e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:53:58.060371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f216f1-e41d-49ce-97e3-c22349fc8e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:53:58.061867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f216f1-e41d-49ce-97e3-c22349fc8e2c service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:53:58.071055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 755/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:54:00.482592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db258f7-7296-4615-886c-7a8acfd613c8 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:54:00.483201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db258f7-7296-4615-886c-7a8acfd613c8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:54:00.483201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db258f7-7296-4615-886c-7a8acfd613c8 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:54:00.484495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 736/1491] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 12 18:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:54:00.489821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc588727-776b-408b-ad2c-f90b375dec84 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:54:00.490283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc588727-776b-408b-ad2c-f90b375dec84 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:54:00.490392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc588727-776b-408b-ad2c-f90b375dec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:54:00.508118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-bc588727-776b-408b-ad2c-f90b375dec84 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:54:00.509987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bc588727-776b-408b-ad2c-f90b375dec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:54:00.517598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 756/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 12 18:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:54:00.556654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db258f7-7296-4615-886c-7a8acfd613c8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:54:00.566867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db258f7-7296-4615-886c-7a8acfd613c8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:54:00.570264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d56b4-ba78-42e9-a9a4-0a9862ba0290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:54:00.570883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d56b4-ba78-42e9-a9a4-0a9862ba0290 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:54:00.571161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d56b4-ba78-42e9-a9a4-0a9862ba0290 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:54:00.571437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d56b4-ba78-42e9-a9a4-0a9862ba0290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:54:00.579935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d56b4-ba78-42e9-a9a4-0a9862ba0290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:54:00.581344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d56b4-ba78-42e9-a9a4-0a9862ba0290 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:54:00.590580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 737/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:55:35.047016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170da0b-10b6-4f9a-a81c-5ab2918b58f3 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.047577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170da0b-10b6-4f9a-a81c-5ab2918b58f3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.047577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170da0b-10b6-4f9a-a81c-5ab2918b58f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.065207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b170da0b-10b6-4f9a-a81c-5ab2918b58f3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:55:35.066406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b170da0b-10b6-4f9a-a81c-5ab2918b58f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:55:35.074510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 757/1494] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:55:35.083728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912e025-2bd1-426c-bf0d-d6da4cd27696 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.084195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912e025-2bd1-426c-bf0d-d6da4cd27696 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.084306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912e025-2bd1-426c-bf0d-d6da4cd27696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.102229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a912e025-2bd1-426c-bf0d-d6da4cd27696 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:55:35.103425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a912e025-2bd1-426c-bf0d-d6da4cd27696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:55:35.110942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 738/1495] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:55:35.115246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170da0b-10b6-4f9a-a81c-5ab2918b58f3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:35.124732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170da0b-10b6-4f9a-a81c-5ab2918b58f3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:35.129207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:35.129880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.130164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.130440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.131157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:55:35.131461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:35.132503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING py.warnings [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:55:35.132503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: warnings.warn(msg) May 12 18:55:35.132503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: May 12 18:55:35.133374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:35.145273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 758/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:55:35.154395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912e025-2bd1-426c-bf0d-d6da4cd27696 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:35.163454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912e025-2bd1-426c-bf0d-d6da4cd27696 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:35.168499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee418c-ef92-4333-94d2-ba47ab774189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:35.169153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee418c-ef92-4333-94d2-ba47ab774189 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.169434 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee418c-ef92-4333-94d2-ba47ab774189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.169738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee418c-ef92-4333-94d2-ba47ab774189 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.170470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee418c-ef92-4333-94d2-ba47ab774189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:35.172222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-9bee418c-ef92-4333-94d2-ba47ab774189 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:55:35.172222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 12 18:55:35.172222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: May 12 18:55:35.173424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee418c-ef92-4333-94d2-ba47ab774189 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:35.211257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 739/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:55:35 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:55:35.216073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:35.225746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95230f66-574b-4359-aeba-3548e1f2a0e4 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:35.280771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266a3d6-f481-4068-b07d-c57940518ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:35.281459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a3d6-f481-4068-b07d-c57940518ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.281764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a3d6-f481-4068-b07d-c57940518ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.282038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a3d6-f481-4068-b07d-c57940518ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.282730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266a3d6-f481-4068-b07d-c57940518ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:35.283855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING py.warnings [None req-7266a3d6-f481-4068-b07d-c57940518ba5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:55:35.283855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: warnings.warn(msg) May 12 18:55:35.283855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: May 12 18:55:35.285056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266a3d6-f481-4068-b07d-c57940518ba5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:35.307589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 759/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:55:35 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:55:35.309040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee418c-ef92-4333-94d2-ba47ab774189 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:35.319034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee418c-ef92-4333-94d2-ba47ab774189 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:35.324293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9ecd-013d-4ffa-aea1-d358095f608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:35.324959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9ecd-013d-4ffa-aea1-d358095f608e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.325243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9ecd-013d-4ffa-aea1-d358095f608e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.325519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9ecd-013d-4ffa-aea1-d358095f608e admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.326268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d9ecd-013d-4ffa-aea1-d358095f608e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:35.327269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-624d9ecd-013d-4ffa-aea1-d358095f608e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:55:35.327269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 12 18:55:35.327269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: May 12 18:55:35.328164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d9ecd-013d-4ffa-aea1-d358095f608e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:35.341371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 740/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:55:35.345984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266a3d6-f481-4068-b07d-c57940518ba5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:35.355715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266a3d6-f481-4068-b07d-c57940518ba5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:35.360333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e55fb4-e512-4754-8de1-9173e1e6ade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:35.360974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e55fb4-e512-4754-8de1-9173e1e6ade6 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.361255 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e55fb4-e512-4754-8de1-9173e1e6ade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.361550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e55fb4-e512-4754-8de1-9173e1e6ade6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.362265 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e55fb4-e512-4754-8de1-9173e1e6ade6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:35.363304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING py.warnings [None req-f0e55fb4-e512-4754-8de1-9173e1e6ade6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:55:35.363304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: warnings.warn(msg) May 12 18:55:35.363304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: May 12 18:55:35.364189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e55fb4-e512-4754-8de1-9173e1e6ade6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:35.377555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 760/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:55:35.381688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9ecd-013d-4ffa-aea1-d358095f608e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:35.391956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9ecd-013d-4ffa-aea1-d358095f608e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:35.396452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658547d-a88b-440f-9b33-2e94f6547e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:35.397313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658547d-a88b-440f-9b33-2e94f6547e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.397883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658547d-a88b-440f-9b33-2e94f6547e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.398156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658547d-a88b-440f-9b33-2e94f6547e34 admin admin] PATH_INFO: `/v3/projects/8742a88332ed4735b0f6781def489f75/users/fcf2f9a8512c46ec865e5936c95a593f/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.412519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658547d-a88b-440f-9b33-2e94f6547e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8742a88332ed4735b0f6781def489f75, user_id=fcf2f9a8512c46ec865e5936c95a593f, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:35.413555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-d658547d-a88b-440f-9b33-2e94f6547e34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:55:35.413555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 12 18:55:35.413555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: May 12 18:55:35.415458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658547d-a88b-440f-9b33-2e94f6547e34 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:35.428956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 741/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:55:35 2022] PUT /identity/v3/projects/8742a88332ed4735b0f6781def489f75/users/fcf2f9a8512c46ec865e5936c95a593f/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:55:35.440095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8ad19-f455-4885-8429-9a4b9e109545 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.440388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8ad19-f455-4885-8429-9a4b9e109545 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.440669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8ad19-f455-4885-8429-9a4b9e109545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.467239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-fbd8ad19-f455-4885-8429-9a4b9e109545 None None] MFA Rules not processed for user `fcf2f9a8512c46ec865e5936c95a593f`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:55:35.468434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fbd8ad19-f455-4885-8429-9a4b9e109545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:55:35.528165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 761/1502] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:55:35.541103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58887b-7f11-486f-b8af-34395fb279e2 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.541992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58887b-7f11-486f-b8af-34395fb279e2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.542270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58887b-7f11-486f-b8af-34395fb279e2 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.543890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 742/1503] 10.222.0.48 () {54 vars in 963 bytes} [Thu May 12 18:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:55:35.548494 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7ebd-b994-4eb9-8c6b-7f73bf99484b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.548786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7ebd-b994-4eb9-8c6b-7f73bf99484b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.549067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7ebd-b994-4eb9-8c6b-7f73bf99484b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.566306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-91fb7ebd-b994-4eb9-8c6b-7f73bf99484b None None] MFA Rules not processed for user `c25d2d15ebf644b889ab453d1b7ed277`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:55:35.567432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-91fb7ebd-b994-4eb9-8c6b-7f73bf99484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:55:35.616152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 762/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Thu May 12 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:55:35.623434 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58887b-7f11-486f-b8af-34395fb279e2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:35.633784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58887b-7f11-486f-b8af-34395fb279e2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:35.637225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9de9-7e07-485c-a4ca-6fea0b2fc78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:35.637876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9de9-7e07-485c-a4ca-6fea0b2fc78a service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.638158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9de9-7e07-485c-a4ca-6fea0b2fc78a service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.638461 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9de9-7e07-485c-a4ca-6fea0b2fc78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.646357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9de9-7e07-485c-a4ca-6fea0b2fc78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:35.647769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9de9-7e07-485c-a4ca-6fea0b2fc78a service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:35.656937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 743/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:55:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:55:35.698887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed155f-a15e-42b1-8489-66c3133a0ead None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.699179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed155f-a15e-42b1-8489-66c3133a0ead None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.699458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed155f-a15e-42b1-8489-66c3133a0ead None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.700755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 763/1506] 10.222.0.48 () {52 vars in 829 bytes} [Thu May 12 18:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:55:35.704258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9de9-7e07-485c-a4ca-6fea0b2fc78a service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:35.762876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9de9-7e07-485c-a4ca-6fea0b2fc78a service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:35.767287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:35.768136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.768417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.768691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] PATH_INFO: `/v3/users/fcf2f9a8512c46ec865e5936c95a593f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.769892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf2f9a8512c46ec865e5936c95a593f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:35.770889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:55:35.770889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 12 18:55:35.770889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: May 12 18:55:35.772075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:35.832807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf2f9a8512c46ec865e5936c95a593f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:35.850685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf2f9a8512c46ec865e5936c95a593f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:35.862964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf2f9a8512c46ec865e5936c95a593f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:35.863801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf2f9a8512c46ec865e5936c95a593f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:35.873272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf2f9a8512c46ec865e5936c95a593f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:35.879345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 744/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:55:35 2022] DELETE /identity/v3/users/fcf2f9a8512c46ec865e5936c95a593f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:55:35.883754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694704d8-df95-4a69-a88f-72c0441013a5 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:35.884038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694704d8-df95-4a69-a88f-72c0441013a5 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:35.884338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694704d8-df95-4a69-a88f-72c0441013a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:35.902557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-694704d8-df95-4a69-a88f-72c0441013a5 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:55:35.903766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-694704d8-df95-4a69-a88f-72c0441013a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:55:35.958861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 764/1508] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:55:35.968931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:35.970352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:55:36.023531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ab4c6-bc6d-4c67-9a8a-f6232087f1b1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:36.027684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411117a-279b-43a8-bf4d-c7fc6b88635e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:36.028318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411117a-279b-43a8-bf4d-c7fc6b88635e service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:36.028599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411117a-279b-43a8-bf4d-c7fc6b88635e service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:36.028872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411117a-279b-43a8-bf4d-c7fc6b88635e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:36.037325 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411117a-279b-43a8-bf4d-c7fc6b88635e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:36.038779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411117a-279b-43a8-bf4d-c7fc6b88635e service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:36.047991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 745/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:55:36.386283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694704d8-df95-4a69-a88f-72c0441013a5 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:55:36.387816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-694704d8-df95-4a69-a88f-72c0441013a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:55:36.399328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694704d8-df95-4a69-a88f-72c0441013a5 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:55:36.405895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:55:36.406786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:55:36.407197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:55:36.407352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] PATH_INFO: `/v3/projects/8742a88332ed4735b0f6781def489f75` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:55:36.408530 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8742a88332ed4735b0f6781def489f75)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:55:36.409577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING py.warnings [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:55:36.409577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: warnings.warn(msg) May 12 18:55:36.409577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: May 12 18:55:36.410747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:55:36.468639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8742a88332ed4735b0f6781def489f75', 'request_id': 'req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:36.479501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8742a88332ed4735b0f6781def489f75', 'request_id': 'req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:36.492632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8742a88332ed4735b0f6781def489f75', 'request_id': 'req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:36.503442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] The token cache is being invalidate because project 8742a88332ed4735b0f6781def489f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 18:55:36.503721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:36.504350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7602f395-ab0d-4c3b-a3b2-a898f85b4d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:55:36.506002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 765/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 18:55:36 2022] DELETE /identity/v3/projects/8742a88332ed4735b0f6781def489f75 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:57:17.934269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d61c65-d80a-4d8c-988b-4d6639fc4549 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:17.934967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d61c65-d80a-4d8c-988b-4d6639fc4549 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:17.934967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d61c65-d80a-4d8c-988b-4d6639fc4549 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:17.936339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:57:17.941656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b17b-d9d9-4ac9-9803-e7e22be4fd83 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:17.942090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b17b-d9d9-4ac9-9803-e7e22be4fd83 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:17.942219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b17b-d9d9-4ac9-9803-e7e22be4fd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:17.960404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2061b17b-d9d9-4ac9-9803-e7e22be4fd83 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:17.961646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2061b17b-d9d9-4ac9-9803-e7e22be4fd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:18.017190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:18.183307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d61c65-d80a-4d8c-988b-4d6639fc4549 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:57:18.185088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-39d61c65-d80a-4d8c-988b-4d6639fc4549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:18.260295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d61c65-d80a-4d8c-988b-4d6639fc4549 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:57:18.265607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66933e5c-be25-46af-8fc6-70781d4fcc3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:57:18.266253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66933e5c-be25-46af-8fc6-70781d4fcc3c service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:18.266535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66933e5c-be25-46af-8fc6-70781d4fcc3c service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:18.266815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66933e5c-be25-46af-8fc6-70781d4fcc3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:18.274671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66933e5c-be25-46af-8fc6-70781d4fcc3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:57:18.276246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66933e5c-be25-46af-8fc6-70781d4fcc3c service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:57:18.285344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 747/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:57:18.936287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5ecde-60a7-485c-848f-013896c1fcb8 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:18.936588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5ecde-60a7-485c-848f-013896c1fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:18.936946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5ecde-60a7-485c-848f-013896c1fcb8 None None] PATH_INFO: `/v3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:18.938463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 767/1514] 10.222.0.49 () {54 vars in 925 bytes} [Thu May 12 18:57:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:57:18.945134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179f2d-96c5-409e-b78b-5fae2ebee490 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:18.945648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179f2d-96c5-409e-b78b-5fae2ebee490 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:18.945749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179f2d-96c5-409e-b78b-5fae2ebee490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:18.964484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-98179f2d-96c5-409e-b78b-5fae2ebee490 None None] MFA Rules not processed for user `cf772e34d8f14923bb9c1fe883fd3926`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:18.965715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-98179f2d-96c5-409e-b78b-5fae2ebee490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:19.033539 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 748/1515] 10.222.0.49 () {58 vars in 1015 bytes} [Thu May 12 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:19.176305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6cde2-7096-4ff5-8ca0-ebbc395e8507 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:19.176822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6cde2-7096-4ff5-8ca0-ebbc395e8507 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:19.176938 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6cde2-7096-4ff5-8ca0-ebbc395e8507 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:19.178359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 768/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:57:19.183674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282f341-d29b-4b03-a3cc-fef59c272d5a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:19.183965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282f341-d29b-4b03-a3cc-fef59c272d5a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:19.184241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282f341-d29b-4b03-a3cc-fef59c272d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:19.204048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6282f341-d29b-4b03-a3cc-fef59c272d5a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:19.205181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6282f341-d29b-4b03-a3cc-fef59c272d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:19.213353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 749/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:19.362682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6cde2-7096-4ff5-8ca0-ebbc395e8507 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:57:19.376809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6cde2-7096-4ff5-8ca0-ebbc395e8507 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:57:19.382348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3264faa-712f-4a42-8dbc-5e959b1c7e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:57:19.382960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3264faa-712f-4a42-8dbc-5e959b1c7e98 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:19.383241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3264faa-712f-4a42-8dbc-5e959b1c7e98 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:19.383517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3264faa-712f-4a42-8dbc-5e959b1c7e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:19.391404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3264faa-712f-4a42-8dbc-5e959b1c7e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:57:19.392985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3264faa-712f-4a42-8dbc-5e959b1c7e98 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:57:19.402809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 769/1518] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:57:27.828432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b873ab-9e9a-4ef3-87af-3b118092502a None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:27.828946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b873ab-9e9a-4ef3-87af-3b118092502a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:27.828946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b873ab-9e9a-4ef3-87af-3b118092502a None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:27.830342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 750/1519] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 12 18:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:57:27.835119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba9a11-b91e-4be5-8ffd-0fc355c50638 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:27.835552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba9a11-b91e-4be5-8ffd-0fc355c50638 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:27.835694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba9a11-b91e-4be5-8ffd-0fc355c50638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:27.853642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-55ba9a11-b91e-4be5-8ffd-0fc355c50638 None None] MFA Rules not processed for user `cf772e34d8f14923bb9c1fe883fd3926`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:27.854835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-55ba9a11-b91e-4be5-8ffd-0fc355c50638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:27.863212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 770/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 12 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:27.872359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b873ab-9e9a-4ef3-87af-3b118092502a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:57:27.885656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b873ab-9e9a-4ef3-87af-3b118092502a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:57:27.890483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62039ef-faf6-45c6-9ac1-ed319827c9f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf772e34d8f14923bb9c1fe883fd3926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:57:27.891105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62039ef-faf6-45c6-9ac1-ed319827c9f1 service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:27.891391 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62039ef-faf6-45c6-9ac1-ed319827c9f1 service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:27.891665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62039ef-faf6-45c6-9ac1-ed319827c9f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:27.899722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62039ef-faf6-45c6-9ac1-ed319827c9f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:57:27.901308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62039ef-faf6-45c6-9ac1-ed319827c9f1 service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:57:27.910696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 751/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:57:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:57:30.699435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb1113-c9cb-4819-af33-1418b09352a3 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:30.699977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb1113-c9cb-4819-af33-1418b09352a3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:30.700079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb1113-c9cb-4819-af33-1418b09352a3 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:30.701388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:57:30.706255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d891cdc-9245-41d4-a2e5-165db298b8cc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:30.706773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d891cdc-9245-41d4-a2e5-165db298b8cc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:30.706874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d891cdc-9245-41d4-a2e5-165db298b8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:30.849975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5d891cdc-9245-41d4-a2e5-165db298b8cc None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:30.851194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5d891cdc-9245-41d4-a2e5-165db298b8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:30.859488 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:31.009661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb1113-c9cb-4819-af33-1418b09352a3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:57:31.023470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb1113-c9cb-4819-af33-1418b09352a3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:57:31.028990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596043c-6f5a-46e4-af87-edc12118f2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:57:31.029651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596043c-6f5a-46e4-af87-edc12118f2cd service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:31.029932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596043c-6f5a-46e4-af87-edc12118f2cd service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:31.030199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596043c-6f5a-46e4-af87-edc12118f2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:31.038057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596043c-6f5a-46e4-af87-edc12118f2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:57:31.039637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596043c-6f5a-46e4-af87-edc12118f2cd service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:57:31.049323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 772/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:57:31.928773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8148cf-907f-4e08-8a9d-74e885cdc8a3 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:31.929343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8148cf-907f-4e08-8a9d-74e885cdc8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:31.929343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8148cf-907f-4e08-8a9d-74e885cdc8a3 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:31.930786 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 18:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:57:31.936061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6a3c-40e9-47f9-a0a6-87bb59374ed6 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:31.936498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6a3c-40e9-47f9-a0a6-87bb59374ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:31.936605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6a3c-40e9-47f9-a0a6-87bb59374ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:31.955584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-836e6a3c-40e9-47f9-a0a6-87bb59374ed6 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:31.956769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-836e6a3c-40e9-47f9-a0a6-87bb59374ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:31.964956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:32.116892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8148cf-907f-4e08-8a9d-74e885cdc8a3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:57:32.131751 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8148cf-907f-4e08-8a9d-74e885cdc8a3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:57:32.137625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d9f55-0f4d-4ba0-8cf0-a238037fe847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:57:32.138256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d9f55-0f4d-4ba0-8cf0-a238037fe847 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:32.138535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d9f55-0f4d-4ba0-8cf0-a238037fe847 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:32.138798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d9f55-0f4d-4ba0-8cf0-a238037fe847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:32.146577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d9f55-0f4d-4ba0-8cf0-a238037fe847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:57:32.148162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d9f55-0f4d-4ba0-8cf0-a238037fe847 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:57:32.157648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 754/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:57:36.195894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc111240-298f-460d-b592-469a1f446d44 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:36.196450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc111240-298f-460d-b592-469a1f446d44 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:36.196450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc111240-298f-460d-b592-469a1f446d44 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:36.197887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:57:36.203098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91804d5-b72b-4232-9b37-1f65c7732fa9 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:36.203484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91804d5-b72b-4232-9b37-1f65c7732fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:36.203647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91804d5-b72b-4232-9b37-1f65c7732fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:36.220833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f91804d5-b72b-4232-9b37-1f65c7732fa9 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:36.222037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f91804d5-b72b-4232-9b37-1f65c7732fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:36.230148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:36.267557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc111240-298f-460d-b592-469a1f446d44 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:57:36.269203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fc111240-298f-460d-b592-469a1f446d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:36.324606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc111240-298f-460d-b592-469a1f446d44 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:57:36.328102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4decf1c-a438-4ea8-b352-920823bb1e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:57:36.328808 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4decf1c-a438-4ea8-b352-920823bb1e7c service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:36.329082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4decf1c-a438-4ea8-b352-920823bb1e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:36.329353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4decf1c-a438-4ea8-b352-920823bb1e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:36.338643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4decf1c-a438-4ea8-b352-920823bb1e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:57:36.340057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4decf1c-a438-4ea8-b352-920823bb1e7c service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:57:36.349103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 775/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:57:38.536305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d0935-3641-47ba-8e64-e77730b2afff None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:38.536863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d0935-3641-47ba-8e64-e77730b2afff None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:38.536863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d0935-3641-47ba-8e64-e77730b2afff None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:38.538293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:57:38.544373 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322212c-117e-46fd-9d5c-5bb627383ee2 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:38.544775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322212c-117e-46fd-9d5c-5bb627383ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:38.544917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322212c-117e-46fd-9d5c-5bb627383ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:38.562870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-8322212c-117e-46fd-9d5c-5bb627383ee2 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:38.564049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8322212c-117e-46fd-9d5c-5bb627383ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:38.571684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:38.606342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d0935-3641-47ba-8e64-e77730b2afff None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:57:38.616554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d0935-3641-47ba-8e64-e77730b2afff None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:57:38.620613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8761b94-62a5-4c49-90ec-70cb765174fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:57:38.621229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8761b94-62a5-4c49-90ec-70cb765174fe service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:38.621506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8761b94-62a5-4c49-90ec-70cb765174fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:38.621808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8761b94-62a5-4c49-90ec-70cb765174fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:38.630327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8761b94-62a5-4c49-90ec-70cb765174fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:57:38.631730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8761b94-62a5-4c49-90ec-70cb765174fe service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:57:38.640831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 757/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:57:42.331644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f3512-0bb2-472c-afe8-71641ed20ed9 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:42.332248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f3512-0bb2-472c-afe8-71641ed20ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:42.332248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f3512-0bb2-472c-afe8-71641ed20ed9 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:42.333587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:57:42.338922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085f10d-00f0-46b8-a0a1-4a9868e51db3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:42.339394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085f10d-00f0-46b8-a0a1-4a9868e51db3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:42.339510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085f10d-00f0-46b8-a0a1-4a9868e51db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:42.357582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5085f10d-00f0-46b8-a0a1-4a9868e51db3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:42.358786 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5085f10d-00f0-46b8-a0a1-4a9868e51db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:42.366534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:42.636949 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f3512-0bb2-472c-afe8-71641ed20ed9 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:57:42.638574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-054f3512-0bb2-472c-afe8-71641ed20ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:42.693502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f3512-0bb2-472c-afe8-71641ed20ed9 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:57:42.697155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed866af7-c0ff-419e-b107-df097cc05f6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:57:42.698324 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed866af7-c0ff-419e-b107-df097cc05f6d service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:42.698606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed866af7-c0ff-419e-b107-df097cc05f6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:42.698879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed866af7-c0ff-419e-b107-df097cc05f6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:42.707381 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed866af7-c0ff-419e-b107-df097cc05f6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:57:42.708789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed866af7-c0ff-419e-b107-df097cc05f6d service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:57:42.717797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 778/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:57:44.949211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c9ef-3cce-4d57-9102-10434954630b None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:44.949811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c9ef-3cce-4d57-9102-10434954630b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:44.949811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c9ef-3cce-4d57-9102-10434954630b None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:44.951147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 18:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:57:44.956415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9a34d-d985-4d8d-8c96-c13d2d84d765 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:44.956872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9a34d-d985-4d8d-8c96-c13d2d84d765 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:44.957003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9a34d-d985-4d8d-8c96-c13d2d84d765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:44.975051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-15b9a34d-d985-4d8d-8c96-c13d2d84d765 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:57:44.976235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-15b9a34d-d985-4d8d-8c96-c13d2d84d765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:44.984812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 18:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:57:45.253276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8c9ef-3cce-4d57-9102-10434954630b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:57:45.254928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a8c8c9ef-3cce-4d57-9102-10434954630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:57:45.267390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8c9ef-3cce-4d57-9102-10434954630b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:57:45.270782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab15e3-61a2-435c-8c90-ac37539e2054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:57:45.271402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab15e3-61a2-435c-8c90-ac37539e2054 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:57:45.271680 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab15e3-61a2-435c-8c90-ac37539e2054 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:57:45.271949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab15e3-61a2-435c-8c90-ac37539e2054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:57:45.280438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab15e3-61a2-435c-8c90-ac37539e2054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:57:45.281873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab15e3-61a2-435c-8c90-ac37539e2054 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:57:45.291398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 760/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:13.505168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778733-8d35-4d8b-98eb-6e4ac18c4507 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.505943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778733-8d35-4d8b-98eb-6e4ac18c4507 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.505943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778733-8d35-4d8b-98eb-6e4ac18c4507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.539919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-12778733-8d35-4d8b-98eb-6e4ac18c4507 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:13.541347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-12778733-8d35-4d8b-98eb-6e4ac18c4507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:13.554660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 780/1540] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:13.565312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee60105-0eda-46c3-a20f-afa7e79581b0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.565938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee60105-0eda-46c3-a20f-afa7e79581b0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.565938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee60105-0eda-46c3-a20f-afa7e79581b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.590320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0ee60105-0eda-46c3-a20f-afa7e79581b0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:13.591541 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0ee60105-0eda-46c3-a20f-afa7e79581b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:13.610978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 761/1541] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:13.616794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778733-8d35-4d8b-98eb-6e4ac18c4507 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:13.631403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778733-8d35-4d8b-98eb-6e4ac18c4507 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:13.641166 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e8212-2fd1-4cfe-b4d4-eabf91d522c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:13.642065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e8212-2fd1-4cfe-b4d4-eabf91d522c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.642357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e8212-2fd1-4cfe-b4d4-eabf91d522c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.642634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e8212-2fd1-4cfe-b4d4-eabf91d522c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.643390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e8212-2fd1-4cfe-b4d4-eabf91d522c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:13.643699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e8212-2fd1-4cfe-b4d4-eabf91d522c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:13.645391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e8212-2fd1-4cfe-b4d4-eabf91d522c2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:13.664812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 781/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:13.679309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee60105-0eda-46c3-a20f-afa7e79581b0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:13.695266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caec19-ee2c-47c4-bf22-fdbb19cdbe4e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.695604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee60105-0eda-46c3-a20f-afa7e79581b0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:13.695723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caec19-ee2c-47c4-bf22-fdbb19cdbe4e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.696027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caec19-ee2c-47c4-bf22-fdbb19cdbe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.711859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a924-1b45-4f9b-9717-1697ba19004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:13.712553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a924-1b45-4f9b-9717-1697ba19004c admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.712832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a924-1b45-4f9b-9717-1697ba19004c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.713109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a924-1b45-4f9b-9717-1697ba19004c admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.713865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6a924-1b45-4f9b-9717-1697ba19004c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:13.716195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6a924-1b45-4f9b-9717-1697ba19004c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:13.735146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-16caec19-ee2c-47c4-bf22-fdbb19cdbe4e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:13.736348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-16caec19-ee2c-47c4-bf22-fdbb19cdbe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:13.757724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 782/1543] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:13.768506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab508a2-dd38-4963-8fc2-063abfb13a2f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.768848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab508a2-dd38-4963-8fc2-063abfb13a2f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.769065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab508a2-dd38-4963-8fc2-063abfb13a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.775156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 762/1544] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:13.779642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a924-1b45-4f9b-9717-1697ba19004c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:13.810620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7ab508a2-dd38-4963-8fc2-063abfb13a2f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:13.811835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7ab508a2-dd38-4963-8fc2-063abfb13a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:13.896321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a924-1b45-4f9b-9717-1697ba19004c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:13.905858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daace6-cff3-470b-8699-c50f90ae6f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:13.906577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daace6-cff3-470b-8699-c50f90ae6f08 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.906858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daace6-cff3-470b-8699-c50f90ae6f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.907276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daace6-cff3-470b-8699-c50f90ae6f08 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.907976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95daace6-cff3-470b-8699-c50f90ae6f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:13.909061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-95daace6-cff3-470b-8699-c50f90ae6f08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:59:13.909061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 12 18:59:13.909061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: May 12 18:59:13.910399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95daace6-cff3-470b-8699-c50f90ae6f08 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:13.936915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 763/1545] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:13.938209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e61a-2f73-4c31-8451-49c25cb1492e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.938496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e61a-2f73-4c31-8451-49c25cb1492e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.939375 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e61a-2f73-4c31-8451-49c25cb1492e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.940098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 783/1546] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:13.941439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac76bed-a412-43e1-9586-e2e1d8f91abc None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.946201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac76bed-a412-43e1-9586-e2e1d8f91abc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.946506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac76bed-a412-43e1-9586-e2e1d8f91abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.957688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a3a1e61a-2f73-4c31-8451-49c25cb1492e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:13.958890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a3a1e61a-2f73-4c31-8451-49c25cb1492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:13.964973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-aac76bed-a412-43e1-9586-e2e1d8f91abc None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:13.967004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-aac76bed-a412-43e1-9586-e2e1d8f91abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:13.967135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 764/1547] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:13.968174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10037-cf15-4bc9-864d-6b06b92f575c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.968454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10037-cf15-4bc9-864d-6b06b92f575c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.968723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10037-cf15-4bc9-864d-6b06b92f575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.982226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 784/1548] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:13.983792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d5db-d7bf-4cf0-a5ca-9b2f31ca91cb None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.984082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d5db-d7bf-4cf0-a5ca-9b2f31ca91cb None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.984359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d5db-d7bf-4cf0-a5ca-9b2f31ca91cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:13.987514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c2b10037-cf15-4bc9-864d-6b06b92f575c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:13.988723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c2b10037-cf15-4bc9-864d-6b06b92f575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:13.997430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 765/1549] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:13.998698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb662e38-b144-4789-ac90-45f2dea0ec9e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:13.998988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb662e38-b144-4789-ac90-45f2dea0ec9e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:13.999260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb662e38-b144-4789-ac90-45f2dea0ec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.002896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6124d5db-d7bf-4cf0-a5ca-9b2f31ca91cb None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.004073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6124d5db-d7bf-4cf0-a5ca-9b2f31ca91cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.012738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 785/1550] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.013486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d5db-d7bf-4cf0-a5ca-9b2f31ca91cb None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.017170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fb662e38-b144-4789-ac90-45f2dea0ec9e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.018506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fb662e38-b144-4789-ac90-45f2dea0ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.022735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d5db-d7bf-4cf0-a5ca-9b2f31ca91cb None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.026522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 766/1551] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.027449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb662e38-b144-4789-ac90-45f2dea0ec9e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.030242 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b3c72-de7c-419a-b842-596ba5bd211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.031060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b3c72-de7c-419a-b842-596ba5bd211d admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.031346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b3c72-de7c-419a-b842-596ba5bd211d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.031617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b3c72-de7c-419a-b842-596ba5bd211d admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.032341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b3c72-de7c-419a-b842-596ba5bd211d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.033989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b3c72-de7c-419a-b842-596ba5bd211d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.036910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb662e38-b144-4789-ac90-45f2dea0ec9e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.041824 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beccf0-2fe8-413d-903c-bc6e3b5afc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.042730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beccf0-2fe8-413d-903c-bc6e3b5afc7d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.043013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beccf0-2fe8-413d-903c-bc6e3b5afc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.043287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beccf0-2fe8-413d-903c-bc6e3b5afc7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.044011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beccf0-2fe8-413d-903c-bc6e3b5afc7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:14.044318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beccf0-2fe8-413d-903c-bc6e3b5afc7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.044509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 786/1552] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:14.047684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-d1beccf0-2fe8-413d-903c-bc6e3b5afc7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:59:14.047684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 12 18:59:14.047684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: May 12 18:59:14.047925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dabfe-4aa5-4d01-9a9d-1fe7b09171cb None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.047925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dabfe-4aa5-4d01-9a9d-1fe7b09171cb None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.047925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dabfe-4aa5-4d01-9a9d-1fe7b09171cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.048146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beccf0-2fe8-413d-903c-bc6e3b5afc7d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.062616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 767/1553] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:14.063984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1246-aa84-44b3-a699-a74c24f2c171 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.064415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1246-aa84-44b3-a699-a74c24f2c171 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.064700 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1246-aa84-44b3-a699-a74c24f2c171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.065114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f55dabfe-4aa5-4d01-9a9d-1fe7b09171cb None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.066387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f55dabfe-4aa5-4d01-9a9d-1fe7b09171cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.075030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 787/1554] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.076400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66339e-7beb-4983-a63c-435d01f4508b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.076694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66339e-7beb-4983-a63c-435d01f4508b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.076970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66339e-7beb-4983-a63c-435d01f4508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.083259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a74a1246-aa84-44b3-a699-a74c24f2c171 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.084888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a74a1246-aa84-44b3-a699-a74c24f2c171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.092694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 768/1555] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.094072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f9760-cf73-44ef-aca5-1469b38b1842 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.094363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f9760-cf73-44ef-aca5-1469b38b1842 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.094643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f9760-cf73-44ef-aca5-1469b38b1842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.097120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6e66339e-7beb-4983-a63c-435d01f4508b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.098328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6e66339e-7beb-4983-a63c-435d01f4508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.106342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 788/1556] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.107558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515a48-5303-4ab9-b092-3b5bb44f2eb4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.107968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515a48-5303-4ab9-b092-3b5bb44f2eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.108104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515a48-5303-4ab9-b092-3b5bb44f2eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.112691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5d2f9760-cf73-44ef-aca5-1469b38b1842 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.113912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5d2f9760-cf73-44ef-aca5-1469b38b1842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.122560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 769/1557] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.123798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc1268-e27e-4fc3-9835-8cf8795df26a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.124084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc1268-e27e-4fc3-9835-8cf8795df26a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.124362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc1268-e27e-4fc3-9835-8cf8795df26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.126809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-35515a48-5303-4ab9-b092-3b5bb44f2eb4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.128140 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-35515a48-5303-4ab9-b092-3b5bb44f2eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.138091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 789/1558] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.138880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515a48-5303-4ab9-b092-3b5bb44f2eb4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.143714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-dcbc1268-e27e-4fc3-9835-8cf8795df26a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.144896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dcbc1268-e27e-4fc3-9835-8cf8795df26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.148325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515a48-5303-4ab9-b092-3b5bb44f2eb4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.152865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81472e49-3bc2-4cb0-8fd4-5f2d6e80e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.153310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 770/1559] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.153503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472e49-3bc2-4cb0-8fd4-5f2d6e80e557 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.153803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472e49-3bc2-4cb0-8fd4-5f2d6e80e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.154068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472e49-3bc2-4cb0-8fd4-5f2d6e80e557 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.154185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc1268-e27e-4fc3-9835-8cf8795df26a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.154774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81472e49-3bc2-4cb0-8fd4-5f2d6e80e557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.156349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81472e49-3bc2-4cb0-8fd4-5f2d6e80e557 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.163524 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc1268-e27e-4fc3-9835-8cf8795df26a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.170521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 790/1560] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:14.170521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195c5d3-6c61-4ace-a38a-3792710db416 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.170521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195c5d3-6c61-4ace-a38a-3792710db416 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.170521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195c5d3-6c61-4ace-a38a-3792710db416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.171822 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a171b-2de9-4681-a39a-368712ca09f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.172481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a171b-2de9-4681-a39a-368712ca09f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.172765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a171b-2de9-4681-a39a-368712ca09f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.173039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a171b-2de9-4681-a39a-368712ca09f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.173747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a171b-2de9-4681-a39a-368712ca09f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.175646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a171b-2de9-4681-a39a-368712ca09f8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.187625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9195c5d3-6c61-4ace-a38a-3792710db416 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.188817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9195c5d3-6c61-4ace-a38a-3792710db416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.197084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 791/1561] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.197996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195c5d3-6c61-4ace-a38a-3792710db416 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.206043 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 771/1562] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.206043 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a171b-2de9-4681-a39a-368712ca09f8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.210623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195c5d3-6c61-4ace-a38a-3792710db416 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.263331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a171b-2de9-4681-a39a-368712ca09f8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.263543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0aee5-b90f-422c-9828-5e854ed609a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.264096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0aee5-b90f-422c-9828-5e854ed609a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.264384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0aee5-b90f-422c-9828-5e854ed609a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.264661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0aee5-b90f-422c-9828-5e854ed609a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.265379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0aee5-b90f-422c-9828-5e854ed609a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:14.265725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0aee5-b90f-422c-9828-5e854ed609a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.267319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0aee5-b90f-422c-9828-5e854ed609a0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.267731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505950d-be68-4971-b82d-ec233a02a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.268433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505950d-be68-4971-b82d-ec233a02a25b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.268661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505950d-be68-4971-b82d-ec233a02a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.268929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505950d-be68-4971-b82d-ec233a02a25b admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.269684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505950d-be68-4971-b82d-ec233a02a25b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:14.269988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505950d-be68-4971-b82d-ec233a02a25b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.271555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505950d-be68-4971-b82d-ec233a02a25b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.279278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 792/1563] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:14.280067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0aee5-b90f-422c-9828-5e854ed609a0 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.283536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 772/1564] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:14.284353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505950d-be68-4971-b82d-ec233a02a25b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.295309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505950d-be68-4971-b82d-ec233a02a25b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.296822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0aee5-b90f-422c-9828-5e854ed609a0 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.300011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a77d3-8154-4779-8c59-fbe410c92172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.300704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a77d3-8154-4779-8c59-fbe410c92172 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.301058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a77d3-8154-4779-8c59-fbe410c92172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.301248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473b75e-cefe-43c2-bf4b-d2d93ca09627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.301475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a77d3-8154-4779-8c59-fbe410c92172 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.301929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473b75e-cefe-43c2-bf4b-d2d93ca09627 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.302209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473b75e-cefe-43c2-bf4b-d2d93ca09627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.302414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a77d3-8154-4779-8c59-fbe410c92172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:14.302519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473b75e-cefe-43c2-bf4b-d2d93ca09627 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.302972 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a77d3-8154-4779-8c59-fbe410c92172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.303184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473b75e-cefe-43c2-bf4b-d2d93ca09627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:14.303596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473b75e-cefe-43c2-bf4b-d2d93ca09627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.304582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a77d3-8154-4779-8c59-fbe410c92172 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.305157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473b75e-cefe-43c2-bf4b-d2d93ca09627 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.316382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 773/1565] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:14.316830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 793/1566] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:14.317020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a77d3-8154-4779-8c59-fbe410c92172 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.318379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473b75e-cefe-43c2-bf4b-d2d93ca09627 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.328850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473b75e-cefe-43c2-bf4b-d2d93ca09627 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.332830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a77d3-8154-4779-8c59-fbe410c92172 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.333358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d6546-a3b8-4594-a057-d9c97b3b36a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.334288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6546-a3b8-4594-a057-d9c97b3b36a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.334611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6546-a3b8-4594-a057-d9c97b3b36a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.335463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6546-a3b8-4594-a057-d9c97b3b36a3 admin admin] PATH_INFO: `/v3/projects/1579004868f04df3baa3ad959277ba00/users/e1ebd0110fff4620b11e881c90470cda/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.338080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e016a-c58f-431c-9c75-89ef8eb600a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.338722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e016a-c58f-431c-9c75-89ef8eb600a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.339006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e016a-c58f-431c-9c75-89ef8eb600a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.339280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e016a-c58f-431c-9c75-89ef8eb600a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.339996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e016a-c58f-431c-9c75-89ef8eb600a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:14.340331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e016a-c58f-431c-9c75-89ef8eb600a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.341949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e016a-c58f-431c-9c75-89ef8eb600a9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.349313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d6546-a3b8-4594-a057-d9c97b3b36a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1579004868f04df3baa3ad959277ba00, user_id=e1ebd0110fff4620b11e881c90470cda, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.350402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING py.warnings [None req-7c8d6546-a3b8-4594-a057-d9c97b3b36a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:59:14.350402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: warnings.warn(msg) May 12 18:59:14.350402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: May 12 18:59:14.352285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d6546-a3b8-4594-a057-d9c97b3b36a3 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.353773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 774/1567] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:14.354759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e016a-c58f-431c-9c75-89ef8eb600a9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.365034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e016a-c58f-431c-9c75-89ef8eb600a9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.366669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 794/1568] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:14 2022] PUT /identity/v3/projects/1579004868f04df3baa3ad959277ba00/users/e1ebd0110fff4620b11e881c90470cda/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:14.367600 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d6546-a3b8-4594-a057-d9c97b3b36a3 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.420046 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e704c-4199-4401-ae13-463159afb99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.420823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e704c-4199-4401-ae13-463159afb99c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.421166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e704c-4199-4401-ae13-463159afb99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.421440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e704c-4199-4401-ae13-463159afb99c admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.422182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e704c-4199-4401-ae13-463159afb99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:14.422483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e704c-4199-4401-ae13-463159afb99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.424168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e704c-4199-4401-ae13-463159afb99c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.425485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d6546-a3b8-4594-a057-d9c97b3b36a3 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.429986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ac03d-1a9f-4d38-adce-4c4dad893de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.430650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ac03d-1a9f-4d38-adce-4c4dad893de2 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.430933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ac03d-1a9f-4d38-adce-4c4dad893de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.431206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ac03d-1a9f-4d38-adce-4c4dad893de2 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.431888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ac03d-1a9f-4d38-adce-4c4dad893de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.433809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ac03d-1a9f-4d38-adce-4c4dad893de2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.435245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 775/1569] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:14.436007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e704c-4199-4401-ae13-463159afb99c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.449303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e704c-4199-4401-ae13-463159afb99c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.454108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf5609-35ec-43cd-a35c-0b8fabfe2b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.454734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 795/1570] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.458132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf5609-35ec-43cd-a35c-0b8fabfe2b3f admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.458132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf5609-35ec-43cd-a35c-0b8fabfe2b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.458132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf5609-35ec-43cd-a35c-0b8fabfe2b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.458398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ac03d-1a9f-4d38-adce-4c4dad893de2 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.458503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf5609-35ec-43cd-a35c-0b8fabfe2b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.458503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf5609-35ec-43cd-a35c-0b8fabfe2b3f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.465433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ac03d-1a9f-4d38-adce-4c4dad893de2 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.470076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e13a0-c35d-4661-b452-94bc401bab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.470707 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e13a0-c35d-4661-b452-94bc401bab30 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.470991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e13a0-c35d-4661-b452-94bc401bab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.471268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e13a0-c35d-4661-b452-94bc401bab30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.471936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e13a0-c35d-4661-b452-94bc401bab30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.472948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING py.warnings [None req-907e13a0-c35d-4661-b452-94bc401bab30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:59:14.472948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: warnings.warn(msg) May 12 18:59:14.472948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: May 12 18:59:14.474170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e13a0-c35d-4661-b452-94bc401bab30 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.485022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 776/1571] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.486030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf5609-35ec-43cd-a35c-0b8fabfe2b3f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.502299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 796/1572] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.503563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e13a0-c35d-4661-b452-94bc401bab30 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.546773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf5609-35ec-43cd-a35c-0b8fabfe2b3f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.561943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e13a0-c35d-4661-b452-94bc401bab30 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.566476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde32f9-beeb-4a38-8802-4d91b7232a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.567127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde32f9-beeb-4a38-8802-4d91b7232a87 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.567411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde32f9-beeb-4a38-8802-4d91b7232a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.567692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde32f9-beeb-4a38-8802-4d91b7232a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.568372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde32f9-beeb-4a38-8802-4d91b7232a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.570820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde32f9-beeb-4a38-8802-4d91b7232a87 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.595757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 797/1573] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.596667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde32f9-beeb-4a38-8802-4d91b7232a87 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.603422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55196545-5ed4-4da9-88ee-1fc84b1a92c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.604079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55196545-5ed4-4da9-88ee-1fc84b1a92c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.604359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55196545-5ed4-4da9-88ee-1fc84b1a92c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.604632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55196545-5ed4-4da9-88ee-1fc84b1a92c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.605315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55196545-5ed4-4da9-88ee-1fc84b1a92c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.607262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55196545-5ed4-4da9-88ee-1fc84b1a92c5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.632410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 777/1574] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.633781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca73bab-c341-483b-8bd7-ffb6c78f9bc2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.634070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca73bab-c341-483b-8bd7-ffb6c78f9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.634350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca73bab-c341-483b-8bd7-ffb6c78f9bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.651546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8ca73bab-c341-483b-8bd7-ffb6c78f9bc2 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:14.652736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8ca73bab-c341-483b-8bd7-ffb6c78f9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:14.658648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde32f9-beeb-4a38-8802-4d91b7232a87 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.708907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 778/1575] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:14.709834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca73bab-c341-483b-8bd7-ffb6c78f9bc2 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.713177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d1b7b-f0df-4d6b-ba80-0938b6c340cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.713985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d1b7b-f0df-4d6b-ba80-0938b6c340cb admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.714338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d1b7b-f0df-4d6b-ba80-0938b6c340cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.714727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d1b7b-f0df-4d6b-ba80-0938b6c340cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.715509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d1b7b-f0df-4d6b-ba80-0938b6c340cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.717510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d1b7b-f0df-4d6b-ba80-0938b6c340cb admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.718952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca73bab-c341-483b-8bd7-ffb6c78f9bc2 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.723389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b468b86-0574-462f-937e-327813c0bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.724024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b468b86-0574-462f-937e-327813c0bf66 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.724302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b468b86-0574-462f-937e-327813c0bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.724574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b468b86-0574-462f-937e-327813c0bf66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.725285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b468b86-0574-462f-937e-327813c0bf66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.727207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b468b86-0574-462f-937e-327813c0bf66 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.742942 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 798/1576] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.743753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d1b7b-f0df-4d6b-ba80-0938b6c340cb admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.753011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 779/1577] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.755903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b468b86-0574-462f-937e-327813c0bf66 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.802168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d1b7b-f0df-4d6b-ba80-0938b6c340cb admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.816134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b468b86-0574-462f-937e-327813c0bf66 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.821508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44120234-cc49-4125-9891-848b614c65a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.822196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44120234-cc49-4125-9891-848b614c65a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.822473 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44120234-cc49-4125-9891-848b614c65a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.822748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44120234-cc49-4125-9891-848b614c65a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.823474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44120234-cc49-4125-9891-848b614c65a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.825414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44120234-cc49-4125-9891-848b614c65a5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.844874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 780/1578] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.845708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44120234-cc49-4125-9891-848b614c65a5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.854905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44120234-cc49-4125-9891-848b614c65a5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.859362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62948bef-f53a-4649-a975-901265a9120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.859824 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7af33-a74f-4da2-a6fa-fe0803f99166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.859995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62948bef-f53a-4649-a975-901265a9120d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.860278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62948bef-f53a-4649-a975-901265a9120d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.860551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62948bef-f53a-4649-a975-901265a9120d admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.860654 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7af33-a74f-4da2-a6fa-fe0803f99166 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.860886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7af33-a74f-4da2-a6fa-fe0803f99166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.861164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7af33-a74f-4da2-a6fa-fe0803f99166 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.861267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62948bef-f53a-4649-a975-901265a9120d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.861926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7af33-a74f-4da2-a6fa-fe0803f99166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.863128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62948bef-f53a-4649-a975-901265a9120d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.863561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7af33-a74f-4da2-a6fa-fe0803f99166 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.873881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 799/1579] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:14.874894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7af33-a74f-4da2-a6fa-fe0803f99166 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.884652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 781/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/users => generated 294 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.885514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62948bef-f53a-4649-a975-901265a9120d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.888796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7af33-a74f-4da2-a6fa-fe0803f99166 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.893283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3b06e-07df-40bf-850f-3712f78c07a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.893970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3b06e-07df-40bf-850f-3712f78c07a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.894252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3b06e-07df-40bf-850f-3712f78c07a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.894527 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3b06e-07df-40bf-850f-3712f78c07a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.894661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62948bef-f53a-4649-a975-901265a9120d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.895277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3b06e-07df-40bf-850f-3712f78c07a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.897139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3b06e-07df-40bf-850f-3712f78c07a4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.899202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d997150-e94b-4ccd-a084-54c34fdc6fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.899833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d997150-e94b-4ccd-a084-54c34fdc6fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.900116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d997150-e94b-4ccd-a084-54c34fdc6fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.900390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d997150-e94b-4ccd-a084-54c34fdc6fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.901058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d997150-e94b-4ccd-a084-54c34fdc6fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.902982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d997150-e94b-4ccd-a084-54c34fdc6fa6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.919831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 800/1581] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.919831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3b06e-07df-40bf-850f-3712f78c07a4 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.925310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 782/1582] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/users => generated 289 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.925310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d997150-e94b-4ccd-a084-54c34fdc6fa6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.932919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d997150-e94b-4ccd-a084-54c34fdc6fa6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.937694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ec9eb-34f7-4aa5-9ef5-d998d596bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.938340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ec9eb-34f7-4aa5-9ef5-d998d596bb8b admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.938615 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ec9eb-34f7-4aa5-9ef5-d998d596bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.938890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ec9eb-34f7-4aa5-9ef5-d998d596bb8b admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.939559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ec9eb-34f7-4aa5-9ef5-d998d596bb8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.941457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ec9eb-34f7-4aa5-9ef5-d998d596bb8b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.961508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 783/1583] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/users => generated 287 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:14.965067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ec9eb-34f7-4aa5-9ef5-d998d596bb8b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:14.974088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ec9eb-34f7-4aa5-9ef5-d998d596bb8b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.976835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3b06e-07df-40bf-850f-3712f78c07a4 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:14.978623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2cd5e-9329-488c-a37b-e4d1817b5d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.979248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2cd5e-9329-488c-a37b-e4d1817b5d1c admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.979531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2cd5e-9329-488c-a37b-e4d1817b5d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.979805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2cd5e-9329-488c-a37b-e4d1817b5d1c admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.980472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2cd5e-9329-488c-a37b-e4d1817b5d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.980747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71e8a-82b5-446b-b4ce-1740579b8c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:14.981391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71e8a-82b5-446b-b4ce-1740579b8c6c service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:14.981705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71e8a-82b5-446b-b4ce-1740579b8c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:14.982086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71e8a-82b5-446b-b4ce-1740579b8c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:14.982410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2cd5e-9329-488c-a37b-e4d1817b5d1c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:14.991560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d71e8a-82b5-446b-b4ce-1740579b8c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:14.993156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d71e8a-82b5-446b-b4ce-1740579b8c6c service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.002552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 801/1584] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:15.003334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71e8a-82b5-446b-b4ce-1740579b8c6c service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.007230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 784/1585] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:14 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:15.007230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2cd5e-9329-488c-a37b-e4d1817b5d1c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.012997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71e8a-82b5-446b-b4ce-1740579b8c6c service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.016538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2cd5e-9329-488c-a37b-e4d1817b5d1c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.018291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dd6b3-b739-47f7-8f66-88c32b06a802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.019130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dd6b3-b739-47f7-8f66-88c32b06a802 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.019482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dd6b3-b739-47f7-8f66-88c32b06a802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.019865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dd6b3-b739-47f7-8f66-88c32b06a802 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.020655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dd6b3-b739-47f7-8f66-88c32b06a802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.021393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641da200-ee84-44bc-a6b3-b041054c1413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.022172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641da200-ee84-44bc-a6b3-b041054c1413 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.022395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dd6b3-b739-47f7-8f66-88c32b06a802 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.022595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641da200-ee84-44bc-a6b3-b041054c1413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.022926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641da200-ee84-44bc-a6b3-b041054c1413 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.023727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641da200-ee84-44bc-a6b3-b041054c1413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.025516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641da200-ee84-44bc-a6b3-b041054c1413 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.032829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 802/1586] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.033613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dd6b3-b739-47f7-8f66-88c32b06a802 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.043518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 785/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.043518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641da200-ee84-44bc-a6b3-b041054c1413 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.049409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dd6b3-b739-47f7-8f66-88c32b06a802 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.055430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641da200-ee84-44bc-a6b3-b041054c1413 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.055620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f367-82b0-4a5d-9392-f5f5fb354837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.056274 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f367-82b0-4a5d-9392-f5f5fb354837 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.056585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f367-82b0-4a5d-9392-f5f5fb354837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.057048 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f367-82b0-4a5d-9392-f5f5fb354837 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.057808 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946f367-82b0-4a5d-9392-f5f5fb354837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.059522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946f367-82b0-4a5d-9392-f5f5fb354837 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.060967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c8baa-64bf-452e-89ff-1ce2a7864d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.061719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c8baa-64bf-452e-89ff-1ce2a7864d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.062180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c8baa-64bf-452e-89ff-1ce2a7864d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.062403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c8baa-64bf-452e-89ff-1ce2a7864d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.063193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c8baa-64bf-452e-89ff-1ce2a7864d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.065242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c8baa-64bf-452e-89ff-1ce2a7864d73 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.072548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 803/1588] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.076063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f367-82b0-4a5d-9392-f5f5fb354837 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.080007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 786/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.081027 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c8baa-64bf-452e-89ff-1ce2a7864d73 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.088448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f367-82b0-4a5d-9392-f5f5fb354837 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.091712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c8baa-64bf-452e-89ff-1ce2a7864d73 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.095178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02529c18-5a79-402c-8ca4-1b3523520a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.096142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02529c18-5a79-402c-8ca4-1b3523520a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.096537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02529c18-5a79-402c-8ca4-1b3523520a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.097284 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02529c18-5a79-402c-8ca4-1b3523520a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.097401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cf4ed-5e4a-4122-a1c3-94e128b2f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.097662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02529c18-5a79-402c-8ca4-1b3523520a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.097768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cf4ed-5e4a-4122-a1c3-94e128b2f17a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.098027 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cf4ed-5e4a-4122-a1c3-94e128b2f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.098253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cf4ed-5e4a-4122-a1c3-94e128b2f17a admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.098984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cf4ed-5e4a-4122-a1c3-94e128b2f17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.099683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02529c18-5a79-402c-8ca4-1b3523520a8d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.101514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cf4ed-5e4a-4122-a1c3-94e128b2f17a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.111357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 804/1590] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.112160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02529c18-5a79-402c-8ca4-1b3523520a8d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.116829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 787/1591] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.118030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cf4ed-5e4a-4122-a1c3-94e128b2f17a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.124145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02529c18-5a79-402c-8ca4-1b3523520a8d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.129771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe2ce-4ebf-4587-9893-8bbc5aa0b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.130444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe2ce-4ebf-4587-9893-8bbc5aa0b759 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.130726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe2ce-4ebf-4587-9893-8bbc5aa0b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.130855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cf4ed-5e4a-4122-a1c3-94e128b2f17a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.131037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe2ce-4ebf-4587-9893-8bbc5aa0b759 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.131848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fe2ce-4ebf-4587-9893-8bbc5aa0b759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.133337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fe2ce-4ebf-4587-9893-8bbc5aa0b759 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.135583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bcc3-9761-4921-97f9-cde14fc03255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.136308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bcc3-9761-4921-97f9-cde14fc03255 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.136631 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bcc3-9761-4921-97f9-cde14fc03255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.136886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bcc3-9761-4921-97f9-cde14fc03255 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.137719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bcc3-9761-4921-97f9-cde14fc03255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.139331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bcc3-9761-4921-97f9-cde14fc03255 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.144143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 805/1592] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.144143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe2ce-4ebf-4587-9893-8bbc5aa0b759 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.155139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 788/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.157460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bcc3-9761-4921-97f9-cde14fc03255 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.159524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe2ce-4ebf-4587-9893-8bbc5aa0b759 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.168109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16253ed2-2431-4e54-a7de-0888d166e687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.168109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16253ed2-2431-4e54-a7de-0888d166e687 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.168109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16253ed2-2431-4e54-a7de-0888d166e687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.168109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16253ed2-2431-4e54-a7de-0888d166e687 admin admin] PATH_INFO: `/v3/projects/eb2e124562e34719a49be3de45e6cf37/users/1df4257419c4434fa22edb0805c1a204/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.176868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bcc3-9761-4921-97f9-cde14fc03255 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.185823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16253ed2-2431-4e54-a7de-0888d166e687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2e124562e34719a49be3de45e6cf37, user_id=1df4257419c4434fa22edb0805c1a204, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.189346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16253ed2-2431-4e54-a7de-0888d166e687 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.191265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcf33b-7cb9-4a3b-9a43-4a5aa182fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.192329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcf33b-7cb9-4a3b-9a43-4a5aa182fe64 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.192682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcf33b-7cb9-4a3b-9a43-4a5aa182fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.193306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcf33b-7cb9-4a3b-9a43-4a5aa182fe64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.194997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcf33b-7cb9-4a3b-9a43-4a5aa182fe64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.196995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcf33b-7cb9-4a3b-9a43-4a5aa182fe64 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.204979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 806/1594] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:15 2022] PUT /identity/v3/projects/eb2e124562e34719a49be3de45e6cf37/users/1df4257419c4434fa22edb0805c1a204/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:15.205732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16253ed2-2431-4e54-a7de-0888d166e687 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.210532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 789/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.215026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcf33b-7cb9-4a3b-9a43-4a5aa182fe64 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.225826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcf33b-7cb9-4a3b-9a43-4a5aa182fe64 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.272450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16253ed2-2431-4e54-a7de-0888d166e687 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.277517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fbcab-9468-4f6a-9eeb-bd4f42f5d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.278308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fbcab-9468-4f6a-9eeb-bd4f42f5d0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.278663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fbcab-9468-4f6a-9eeb-bd4f42f5d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.279033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fbcab-9468-4f6a-9eeb-bd4f42f5d0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.279839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fbcab-9468-4f6a-9eeb-bd4f42f5d0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.281561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fbcab-9468-4f6a-9eeb-bd4f42f5d0c6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.285011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13e0b8-8db2-4e22-a209-819a871d3348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.285737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13e0b8-8db2-4e22-a209-819a871d3348 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.286013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13e0b8-8db2-4e22-a209-819a871d3348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.286288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13e0b8-8db2-4e22-a209-819a871d3348 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.287055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13e0b8-8db2-4e22-a209-819a871d3348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.289323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13e0b8-8db2-4e22-a209-819a871d3348 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.293239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 807/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.294192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fbcab-9468-4f6a-9eeb-bd4f42f5d0c6 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.300028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 790/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.300871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13e0b8-8db2-4e22-a209-819a871d3348 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.308397 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fbcab-9468-4f6a-9eeb-bd4f42f5d0c6 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.311238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13e0b8-8db2-4e22-a209-819a871d3348 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.313155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658adca-13f8-49ba-adda-c0a62ebe6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.313976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658adca-13f8-49ba-adda-c0a62ebe6de9 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.314542 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658adca-13f8-49ba-adda-c0a62ebe6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.314883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658adca-13f8-49ba-adda-c0a62ebe6de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.315675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658adca-13f8-49ba-adda-c0a62ebe6de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.315959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0192b8-7c42-485a-908e-218ba706e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.316617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0192b8-7c42-485a-908e-218ba706e602 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.316903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0192b8-7c42-485a-908e-218ba706e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.317175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0192b8-7c42-485a-908e-218ba706e602 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.317642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658adca-13f8-49ba-adda-c0a62ebe6de9 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.317933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0192b8-7c42-485a-908e-218ba706e602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.319584 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0192b8-7c42-485a-908e-218ba706e602 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.331175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 808/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.331175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658adca-13f8-49ba-adda-c0a62ebe6de9 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.331422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 791/1599] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:15.331422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ffdd-9d7b-4407-aa00-4dbf5589c4ce None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.331422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ffdd-9d7b-4407-aa00-4dbf5589c4ce None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.331685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ffdd-9d7b-4407-aa00-4dbf5589c4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.343170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658adca-13f8-49ba-adda-c0a62ebe6de9 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.348274 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9df025-4e81-45d5-addc-24747db254c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.349082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9fe2ffdd-9d7b-4407-aa00-4dbf5589c4ce None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:15.349211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df025-4e81-45d5-addc-24747db254c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.349413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df025-4e81-45d5-addc-24747db254c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.349733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df025-4e81-45d5-addc-24747db254c8 admin admin] PATH_INFO: `/v3/projects/4517de5071714dd9928b56103b14efcf/users/7f9d8187e531469faee011dbbf87075a/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.350850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9fe2ffdd-9d7b-4407-aa00-4dbf5589c4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:15.360382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 792/1600] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:15.361410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2ffdd-9d7b-4407-aa00-4dbf5589c4ce None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.369467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9df025-4e81-45d5-addc-24747db254c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4517de5071714dd9928b56103b14efcf, user_id=7f9d8187e531469faee011dbbf87075a, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.372561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9df025-4e81-45d5-addc-24747db254c8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.375180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2ffdd-9d7b-4407-aa00-4dbf5589c4ce None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.382356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c0800-d708-4228-ae64-b77c69936698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.384452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c0800-d708-4228-ae64-b77c69936698 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.384806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c0800-d708-4228-ae64-b77c69936698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.385143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c0800-d708-4228-ae64-b77c69936698 admin admin] PATH_INFO: `/v3/projects/2a8b3b5b2c48416c8c6b99b27cfa3aeb/users/803b29a8c5e34ef0993913c0b08ccfd1/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.390561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 809/1601] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:15 2022] PUT /identity/v3/projects/4517de5071714dd9928b56103b14efcf/users/7f9d8187e531469faee011dbbf87075a/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:15.394591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9df025-4e81-45d5-addc-24747db254c8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.403332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c0800-d708-4228-ae64-b77c69936698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8b3b5b2c48416c8c6b99b27cfa3aeb, user_id=803b29a8c5e34ef0993913c0b08ccfd1, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.407368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c0800-d708-4228-ae64-b77c69936698 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.422502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 793/1602] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:15 2022] PUT /identity/v3/projects/2a8b3b5b2c48416c8c6b99b27cfa3aeb/users/803b29a8c5e34ef0993913c0b08ccfd1/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:15.423670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c0800-d708-4228-ae64-b77c69936698 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.504775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c0800-d708-4228-ae64-b77c69936698 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.505334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9df025-4e81-45d5-addc-24747db254c8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.510138 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b41d3b-d0a5-4fb6-8301-7ea2c8c53818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.510988 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64861e-bf3d-4f78-96f6-71a47da5625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.511263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b41d3b-d0a5-4fb6-8301-7ea2c8c53818 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.511608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b41d3b-d0a5-4fb6-8301-7ea2c8c53818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.511878 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64861e-bf3d-4f78-96f6-71a47da5625c admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.511994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b41d3b-d0a5-4fb6-8301-7ea2c8c53818 admin admin] PATH_INFO: `/v3/projects/a61f3c6e7974486a9f3a4f9d361c5fb6/users/2c202a7f2c484cd3b0363b75c1a673a3/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.512163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64861e-bf3d-4f78-96f6-71a47da5625c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.512443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64861e-bf3d-4f78-96f6-71a47da5625c admin admin] PATH_INFO: `/v3/projects/32772416f8a24240be41b6df1c52e3b2/users/a18f546f762b4b4ebc4f86a871f69da3/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.528557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b41d3b-d0a5-4fb6-8301-7ea2c8c53818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a61f3c6e7974486a9f3a4f9d361c5fb6, user_id=2c202a7f2c484cd3b0363b75c1a673a3, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.529249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64861e-bf3d-4f78-96f6-71a47da5625c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32772416f8a24240be41b6df1c52e3b2, user_id=a18f546f762b4b4ebc4f86a871f69da3, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.531549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b41d3b-d0a5-4fb6-8301-7ea2c8c53818 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.532407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64861e-bf3d-4f78-96f6-71a47da5625c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.549727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 794/1603] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:15 2022] PUT /identity/v3/projects/a61f3c6e7974486a9f3a4f9d361c5fb6/users/2c202a7f2c484cd3b0363b75c1a673a3/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:15.549727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b41d3b-d0a5-4fb6-8301-7ea2c8c53818 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.550028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 810/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:15 2022] PUT /identity/v3/projects/32772416f8a24240be41b6df1c52e3b2/users/a18f546f762b4b4ebc4f86a871f69da3/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:15.550028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64861e-bf3d-4f78-96f6-71a47da5625c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.619522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64861e-bf3d-4f78-96f6-71a47da5625c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.622799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b41d3b-d0a5-4fb6-8301-7ea2c8c53818 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.624422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357fe1-c7ee-4376-a647-95c3f5b95145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.625424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357fe1-c7ee-4376-a647-95c3f5b95145 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.625811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357fe1-c7ee-4376-a647-95c3f5b95145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.626162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357fe1-c7ee-4376-a647-95c3f5b95145 admin admin] PATH_INFO: `/v3/projects/61be60da66374c5b9c064eefb5b54dfe/users/6dfc6f930dea4e83a4fc58c9b02276f6/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.628222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaca7d9-c14a-4d51-ae39-2042122a9378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.629581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaca7d9-c14a-4d51-ae39-2042122a9378 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.629581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaca7d9-c14a-4d51-ae39-2042122a9378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.629814 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaca7d9-c14a-4d51-ae39-2042122a9378 admin admin] PATH_INFO: `/v3/projects/e919eefce93845b8bbd05ebb732096db/users/3d23a659c657413dbb7d438077f8af03/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.641606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357fe1-c7ee-4376-a647-95c3f5b95145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61be60da66374c5b9c064eefb5b54dfe, user_id=6dfc6f930dea4e83a4fc58c9b02276f6, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.644640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357fe1-c7ee-4376-a647-95c3f5b95145 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.648187 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaca7d9-c14a-4d51-ae39-2042122a9378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e919eefce93845b8bbd05ebb732096db, user_id=3d23a659c657413dbb7d438077f8af03, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.651589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaca7d9-c14a-4d51-ae39-2042122a9378 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.662761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 811/1605] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:15 2022] PUT /identity/v3/projects/61be60da66374c5b9c064eefb5b54dfe/users/6dfc6f930dea4e83a4fc58c9b02276f6/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:15.667593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357fe1-c7ee-4376-a647-95c3f5b95145 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:15.667779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 795/1606] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:15 2022] PUT /identity/v3/projects/e919eefce93845b8bbd05ebb732096db/users/3d23a659c657413dbb7d438077f8af03/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:15.668626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6804a-02e0-430b-a102-127e16d517ac None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.669013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6804a-02e0-430b-a102-127e16d517ac None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.669390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6804a-02e0-430b-a102-127e16d517ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.684241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5f357fe1-c7ee-4376-a647-95c3f5b95145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:15.708675 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2cc6804a-02e0-430b-a102-127e16d517ac None None] MFA Rules not processed for user `7f9d8187e531469faee011dbbf87075a`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:15.711041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2cc6804a-02e0-430b-a102-127e16d517ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:15.753998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357fe1-c7ee-4376-a647-95c3f5b95145 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:15.805066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 796/1607] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:15.806475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539413ed-4334-4d01-9ef0-a96d5eec9236 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.806772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539413ed-4334-4d01-9ef0-a96d5eec9236 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.807053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539413ed-4334-4d01-9ef0-a96d5eec9236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.820947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9bd0-5ae2-4938-8674-c1410ca83504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:15.822536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9bd0-5ae2-4938-8674-c1410ca83504 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.823609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9bd0-5ae2-4938-8674-c1410ca83504 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.824805 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9bd0-5ae2-4938-8674-c1410ca83504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.829107 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-539413ed-4334-4d01-9ef0-a96d5eec9236 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:15.830433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-539413ed-4334-4d01-9ef0-a96d5eec9236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:15.902040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b9bd0-5ae2-4938-8674-c1410ca83504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:15.903506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b9bd0-5ae2-4938-8674-c1410ca83504 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:15.915983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 797/1608] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:15.916821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 812/1609] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:15.918756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bba02d-1af1-4ceb-96db-41b573cd393f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.919052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bba02d-1af1-4ceb-96db-41b573cd393f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.919331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bba02d-1af1-4ceb-96db-41b573cd393f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.926838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfdb46-a7c4-42bc-8bec-49ed70d5d825 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.927379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfdb46-a7c4-42bc-8bec-49ed70d5d825 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.928998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfdb46-a7c4-42bc-8bec-49ed70d5d825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:15.953968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-76bba02d-1af1-4ceb-96db-41b573cd393f None None] MFA Rules not processed for user `a18f546f762b4b4ebc4f86a871f69da3`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:15.955349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-76bba02d-1af1-4ceb-96db-41b573cd393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:15.965783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-39cfdb46-a7c4-42bc-8bec-49ed70d5d825 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:15.971840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-39cfdb46-a7c4-42bc-8bec-49ed70d5d825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:15.992331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 798/1610] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:15.995462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d970-a63a-4657-b1c3-b3dcf51f2624 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:15.995462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d970-a63a-4657-b1c3-b3dcf51f2624 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:15.995462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d970-a63a-4657-b1c3-b3dcf51f2624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.030280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8c37d970-a63a-4657-b1c3-b3dcf51f2624 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:16.033801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8c37d970-a63a-4657-b1c3-b3dcf51f2624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:16.057464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 813/1611] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:16.059223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb842891-ed83-42d7-a00b-4e0bf36189dd None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.059811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb842891-ed83-42d7-a00b-4e0bf36189dd None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.060331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 799/1612] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:16.060698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb842891-ed83-42d7-a00b-4e0bf36189dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.061367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d970-a63a-4657-b1c3-b3dcf51f2624 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.073186 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d970-a63a-4657-b1c3-b3dcf51f2624 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.079435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e41cd-ed92-40ca-bf8c-b2f5d37355f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.080294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e41cd-ed92-40ca-bf8c-b2f5d37355f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.080691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e41cd-ed92-40ca-bf8c-b2f5d37355f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.081044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e41cd-ed92-40ca-bf8c-b2f5d37355f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.081851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e41cd-ed92-40ca-bf8c-b2f5d37355f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.083980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e41cd-ed92-40ca-bf8c-b2f5d37355f4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.106611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-cb842891-ed83-42d7-a00b-4e0bf36189dd None None] MFA Rules not processed for user `3d23a659c657413dbb7d438077f8af03`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:16.108934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-cb842891-ed83-42d7-a00b-4e0bf36189dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:16.115209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 800/1613] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:16 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:16.116629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e41cd-ed92-40ca-bf8c-b2f5d37355f4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.195222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e41cd-ed92-40ca-bf8c-b2f5d37355f4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.201234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a4619-fe94-4030-a9db-7534cd10081a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.202384 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a4619-fe94-4030-a9db-7534cd10081a service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.203274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a4619-fe94-4030-a9db-7534cd10081a service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.203660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a4619-fe94-4030-a9db-7534cd10081a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.241573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 814/1614] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:16.245618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb842891-ed83-42d7-a00b-4e0bf36189dd None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.260811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb842891-ed83-42d7-a00b-4e0bf36189dd None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.265113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc6c5f-8e4b-443e-8d0f-c34499cd88a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.266024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc6c5f-8e4b-443e-8d0f-c34499cd88a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.266468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc6c5f-8e4b-443e-8d0f-c34499cd88a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.266916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc6c5f-8e4b-443e-8d0f-c34499cd88a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.321249 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a4619-fe94-4030-a9db-7534cd10081a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.322985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a4619-fe94-4030-a9db-7534cd10081a service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.347619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 801/1615] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:16.348501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a4619-fe94-4030-a9db-7534cd10081a service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.355258 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc6c5f-8e4b-443e-8d0f-c34499cd88a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.357134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc6c5f-8e4b-443e-8d0f-c34499cd88a0 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.370509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a4619-fe94-4030-a9db-7534cd10081a service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.374296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 815/1616] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:16.376129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc6c5f-8e4b-443e-8d0f-c34499cd88a0 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.387238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9110-8c19-4e14-968b-fdace8e48d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.387940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9110-8c19-4e14-968b-fdace8e48d36 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.388228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9110-8c19-4e14-968b-fdace8e48d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.388359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc6c5f-8e4b-443e-8d0f-c34499cd88a0 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.388491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9110-8c19-4e14-968b-fdace8e48d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.392063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a9110-8c19-4e14-968b-fdace8e48d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.394332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55975-6ecb-4dc6-a562-1305f69b4f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.395159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55975-6ecb-4dc6-a562-1305f69b4f74 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.395452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55975-6ecb-4dc6-a562-1305f69b4f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.395733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55975-6ecb-4dc6-a562-1305f69b4f74 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.396211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a9110-8c19-4e14-968b-fdace8e48d36 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.396481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d55975-6ecb-4dc6-a562-1305f69b4f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.399102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d55975-6ecb-4dc6-a562-1305f69b4f74 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.433550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 816/1617] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:16 2022] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:16.436958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55975-6ecb-4dc6-a562-1305f69b4f74 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.449469 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 802/1618] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:16 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:16.451311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96242-1204-412b-9aa2-ed5b1aadc4a5 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.451495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96242-1204-412b-9aa2-ed5b1aadc4a5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.451939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96242-1204-412b-9aa2-ed5b1aadc4a5 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.453394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55975-6ecb-4dc6-a562-1305f69b4f74 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.464684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 803/1619] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 12 18:59:16 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:59:16.465856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b96242-1204-412b-9aa2-ed5b1aadc4a5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.526695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09634-b5e5-42c7-a20b-e233298bd5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.527548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09634-b5e5-42c7-a20b-e233298bd5da service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.528003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09634-b5e5-42c7-a20b-e233298bd5da service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.528566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09634-b5e5-42c7-a20b-e233298bd5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.559009 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b96242-1204-412b-9aa2-ed5b1aadc4a5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.574349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb298-7a7f-457b-b8d2-fc8102ceacb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.575964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb298-7a7f-457b-b8d2-fc8102ceacb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.577133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb298-7a7f-457b-b8d2-fc8102ceacb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.578467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb298-7a7f-457b-b8d2-fc8102ceacb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.579560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb298-7a7f-457b-b8d2-fc8102ceacb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.583660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb298-7a7f-457b-b8d2-fc8102ceacb3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.610485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 804/1620] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:16.612428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb298-7a7f-457b-b8d2-fc8102ceacb3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.614138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f09634-b5e5-42c7-a20b-e233298bd5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.618744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f09634-b5e5-42c7-a20b-e233298bd5da service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.637333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 817/1621] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:16.639136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b529ee-c367-4a69-998b-a442c45e4a54 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.639529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b529ee-c367-4a69-998b-a442c45e4a54 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.639975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b529ee-c367-4a69-998b-a442c45e4a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.641417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb298-7a7f-457b-b8d2-fc8102ceacb3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.652718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7612c5b-2ef3-4d54-a69e-5f9d8dc8c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.653333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7612c5b-2ef3-4d54-a69e-5f9d8dc8c0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.653663 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7612c5b-2ef3-4d54-a69e-5f9d8dc8c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.653933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7612c5b-2ef3-4d54-a69e-5f9d8dc8c0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.658719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7612c5b-2ef3-4d54-a69e-5f9d8dc8c0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.664963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7612c5b-2ef3-4d54-a69e-5f9d8dc8c0c6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.665630 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-a9b529ee-c367-4a69-998b-a442c45e4a54 None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:16.667786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a9b529ee-c367-4a69-998b-a442c45e4a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:16.713106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 805/1622] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:16 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:16.713106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7612c5b-2ef3-4d54-a69e-5f9d8dc8c0c6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.736092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7612c5b-2ef3-4d54-a69e-5f9d8dc8c0c6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.752051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454c462-f1f9-43de-90e4-8a6b5ddbd55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.752965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c462-f1f9-43de-90e4-8a6b5ddbd55f admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.753253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c462-f1f9-43de-90e4-8a6b5ddbd55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.753655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c462-f1f9-43de-90e4-8a6b5ddbd55f admin admin] PATH_INFO: `/v3/projects/964fa4f36371418f9f9e93b6ffddc225/users/7f0c9efe65a6460e84ee73136c63fd9b/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.770282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 818/1623] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 12 18:59:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:16.771302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b529ee-c367-4a69-998b-a442c45e4a54 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.781098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454c462-f1f9-43de-90e4-8a6b5ddbd55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=964fa4f36371418f9f9e93b6ffddc225, user_id=7f0c9efe65a6460e84ee73136c63fd9b, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.785106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454c462-f1f9-43de-90e4-8a6b5ddbd55f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.798399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b529ee-c367-4a69-998b-a442c45e4a54 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.810286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 806/1624] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:16 2022] PUT /identity/v3/projects/964fa4f36371418f9f9e93b6ffddc225/users/7f0c9efe65a6460e84ee73136c63fd9b/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:16.811446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454c462-f1f9-43de-90e4-8a6b5ddbd55f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.932549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc2d66-d216-48a7-8f44-9cc40d55b9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.933514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc2d66-d216-48a7-8f44-9cc40d55b9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.933924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc2d66-d216-48a7-8f44-9cc40d55b9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.934309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc2d66-d216-48a7-8f44-9cc40d55b9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.935155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc2d66-d216-48a7-8f44-9cc40d55b9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.936651 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454c462-f1f9-43de-90e4-8a6b5ddbd55f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.941459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc2d66-d216-48a7-8f44-9cc40d55b9c6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.945344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca90691-5b0a-48ea-855e-199cf297e4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.946994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90691-5b0a-48ea-855e-199cf297e4ea service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.947505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90691-5b0a-48ea-855e-199cf297e4ea service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.947973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90691-5b0a-48ea-855e-199cf297e4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.957081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 819/1625] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:16.957951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc2d66-d216-48a7-8f44-9cc40d55b9c6 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:16.970098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc2d66-d216-48a7-8f44-9cc40d55b9c6 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:16.978649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be37aa3-ff03-479c-b811-75108f0228c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:16.979525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be37aa3-ff03-479c-b811-75108f0228c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:16.979968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be37aa3-ff03-479c-b811-75108f0228c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:16.980824 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be37aa3-ff03-479c-b811-75108f0228c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:16.981803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be37aa3-ff03-479c-b811-75108f0228c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:16.984187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be37aa3-ff03-479c-b811-75108f0228c8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:16.998762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 820/1626] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:16.999804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be37aa3-ff03-479c-b811-75108f0228c8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:17.015465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be37aa3-ff03-479c-b811-75108f0228c8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:17.026723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da044b3-c33e-4827-9143-76f19c1b6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:17.027863 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da044b3-c33e-4827-9143-76f19c1b6d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.028184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da044b3-c33e-4827-9143-76f19c1b6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.028573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da044b3-c33e-4827-9143-76f19c1b6d32 admin admin] PATH_INFO: `/v3/projects/967a79dd5e174fdb97f559625547c0cc/users/6c8c3c01dafe42dab8b442b44b7febdb/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.043502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca90691-5b0a-48ea-855e-199cf297e4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:17.046888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca90691-5b0a-48ea-855e-199cf297e4ea service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:17.058538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 807/1627] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:17.059074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca90691-5b0a-48ea-855e-199cf297e4ea service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:17.061410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da044b3-c33e-4827-9143-76f19c1b6d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967a79dd5e174fdb97f559625547c0cc, user_id=6c8c3c01dafe42dab8b442b44b7febdb, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:17.065013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da044b3-c33e-4827-9143-76f19c1b6d32 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:17.072752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca90691-5b0a-48ea-855e-199cf297e4ea service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:17.080470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9856c8c-a766-4a37-9217-c4dd0dcbe4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:17.081668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9856c8c-a766-4a37-9217-c4dd0dcbe4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.082111 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9856c8c-a766-4a37-9217-c4dd0dcbe4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.082499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9856c8c-a766-4a37-9217-c4dd0dcbe4c9 admin admin] PATH_INFO: `/v3/projects/964fa4f36371418f9f9e93b6ffddc225/users/7f0c9efe65a6460e84ee73136c63fd9b/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.085377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9856c8c-a766-4a37-9217-c4dd0dcbe4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=964fa4f36371418f9f9e93b6ffddc225, user_id=7f0c9efe65a6460e84ee73136c63fd9b, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:17.088849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9856c8c-a766-4a37-9217-c4dd0dcbe4c9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:17.093856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 821/1628] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:16 2022] PUT /identity/v3/projects/967a79dd5e174fdb97f559625547c0cc/users/6c8c3c01dafe42dab8b442b44b7febdb/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:17.094766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da044b3-c33e-4827-9143-76f19c1b6d32 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:17.107105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 808/1629] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:17 2022] PUT /identity/v3/projects/964fa4f36371418f9f9e93b6ffddc225/users/7f0c9efe65a6460e84ee73136c63fd9b/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:17.120771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503c62f-1130-44c8-a026-e408f1d496d9 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.121371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503c62f-1130-44c8-a026-e408f1d496d9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.121807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503c62f-1130-44c8-a026-e408f1d496d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.176199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7503c62f-1130-44c8-a026-e408f1d496d9 None None] MFA Rules not processed for user `7f0c9efe65a6460e84ee73136c63fd9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:17.177517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7503c62f-1130-44c8-a026-e408f1d496d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:17.189540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da044b3-c33e-4827-9143-76f19c1b6d32 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:17.341107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19534ea2-e4d8-4b8b-83e7-8f0d1b38d4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:17.341886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19534ea2-e4d8-4b8b-83e7-8f0d1b38d4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.342333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19534ea2-e4d8-4b8b-83e7-8f0d1b38d4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.342488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19534ea2-e4d8-4b8b-83e7-8f0d1b38d4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.343566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19534ea2-e4d8-4b8b-83e7-8f0d1b38d4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:17.347015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19534ea2-e4d8-4b8b-83e7-8f0d1b38d4e9 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:17.357665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 809/1630] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:17.374726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503c62f-1130-44c8-a026-e408f1d496d9 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:17.383329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 822/1631] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:17.387396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19534ea2-e4d8-4b8b-83e7-8f0d1b38d4e9 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:17.403424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19534ea2-e4d8-4b8b-83e7-8f0d1b38d4e9 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:17.412744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdd530-a2ff-4c09-9d86-e1dbe474601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:17.413685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdd530-a2ff-4c09-9d86-e1dbe474601c admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.414038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdd530-a2ff-4c09-9d86-e1dbe474601c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.414314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdd530-a2ff-4c09-9d86-e1dbe474601c admin admin] PATH_INFO: `/v3/projects/967a79dd5e174fdb97f559625547c0cc/users/6c8c3c01dafe42dab8b442b44b7febdb/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.422923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdd530-a2ff-4c09-9d86-e1dbe474601c admin admin] RBAC: Authorizing `identity:create_grant(project_id=967a79dd5e174fdb97f559625547c0cc, user_id=6c8c3c01dafe42dab8b442b44b7febdb, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:17.427749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdd530-a2ff-4c09-9d86-e1dbe474601c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:17.465567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 823/1632] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:17 2022] PUT /identity/v3/projects/967a79dd5e174fdb97f559625547c0cc/users/6c8c3c01dafe42dab8b442b44b7febdb/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:17.467196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ca2d-c158-4606-812f-e7b638badac9 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.467456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ca2d-c158-4606-812f-e7b638badac9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.467738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ca2d-c158-4606-812f-e7b638badac9 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.472907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 824/1633] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 12 18:59:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:59:17.475164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efd92a-a7e9-42e7-8e9a-93333bdaf56c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.475452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efd92a-a7e9-42e7-8e9a-93333bdaf56c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.476164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efd92a-a7e9-42e7-8e9a-93333bdaf56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.497926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503c62f-1130-44c8-a026-e408f1d496d9 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:17.518470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f5efd92a-a7e9-42e7-8e9a-93333bdaf56c None None] MFA Rules not processed for user `6c8c3c01dafe42dab8b442b44b7febdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:17.519886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f5efd92a-a7e9-42e7-8e9a-93333bdaf56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:17.603555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7002-08a8-4968-a048-930535b824cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:17.605664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7002-08a8-4968-a048-930535b824cf service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.606191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7002-08a8-4968-a048-930535b824cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.606698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7002-08a8-4968-a048-930535b824cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.624138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 825/1634] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:17.625728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f719436-2a97-4325-bf3f-4e1ac623b0f0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.626131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f719436-2a97-4325-bf3f-4e1ac623b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.626858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f719436-2a97-4325-bf3f-4e1ac623b0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.650201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4f719436-2a97-4325-bf3f-4e1ac623b0f0 None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:17.651775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4f719436-2a97-4325-bf3f-4e1ac623b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:17.740223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e7002-08a8-4968-a048-930535b824cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:17.749485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e7002-08a8-4968-a048-930535b824cf service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:17.750977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 826/1635] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 18:59:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:17.752062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f719436-2a97-4325-bf3f-4e1ac623b0f0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:17.764295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f719436-2a97-4325-bf3f-4e1ac623b0f0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:17.772732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c63f4f-efd4-4d96-826a-0b2da0049038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:17.773285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c63f4f-efd4-4d96-826a-0b2da0049038 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.773606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c63f4f-efd4-4d96-826a-0b2da0049038 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.773885 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c63f4f-efd4-4d96-826a-0b2da0049038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.780216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 810/1636] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:59:17.802299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c63f4f-efd4-4d96-826a-0b2da0049038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:17.805712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c63f4f-efd4-4d96-826a-0b2da0049038 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:17.832638 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 827/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:17.857561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7002-08a8-4968-a048-930535b824cf service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:17.873826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7002-08a8-4968-a048-930535b824cf service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:17.879225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8d0b3-184f-4da4-85c0-cb5512f05757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:17.880296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8d0b3-184f-4da4-85c0-cb5512f05757 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:17.880497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8d0b3-184f-4da4-85c0-cb5512f05757 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:17.880887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8d0b3-184f-4da4-85c0-cb5512f05757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:17.909096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8d0b3-184f-4da4-85c0-cb5512f05757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:17.913094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8d0b3-184f-4da4-85c0-cb5512f05757 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:17.948757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 811/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:18.104580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c63f4f-efd4-4d96-826a-0b2da0049038 service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:18.118044 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c63f4f-efd4-4d96-826a-0b2da0049038 service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:18.133879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653f7b9-d798-4b7e-88da-6dcd894c732e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:18.134694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653f7b9-d798-4b7e-88da-6dcd894c732e service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:18.134973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653f7b9-d798-4b7e-88da-6dcd894c732e service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:18.135399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653f7b9-d798-4b7e-88da-6dcd894c732e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:18.289132 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653f7b9-d798-4b7e-88da-6dcd894c732e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:18.290679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653f7b9-d798-4b7e-88da-6dcd894c732e service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:18.325779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 828/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:18.792759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8d0b3-184f-4da4-85c0-cb5512f05757 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:18.807258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8d0b3-184f-4da4-85c0-cb5512f05757 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:18.814976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a382b-fa76-465d-b5cd-586c246a4567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:18.816126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a382b-fa76-465d-b5cd-586c246a4567 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:18.816589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a382b-fa76-465d-b5cd-586c246a4567 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:18.816779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a382b-fa76-465d-b5cd-586c246a4567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:18.917438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a382b-fa76-465d-b5cd-586c246a4567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:18.918959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a382b-fa76-465d-b5cd-586c246a4567 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:18.944732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 812/1640] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:19.824502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eb121-8d22-4ee4-bd82-3761d40316d3 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:19.825172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eb121-8d22-4ee4-bd82-3761d40316d3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:19.825172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eb121-8d22-4ee4-bd82-3761d40316d3 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:19.827264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 829/1641] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 12 18:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:59:19.844000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ec111-cb00-4eb5-a85c-1e83565ac90c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:19.845698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ec111-cb00-4eb5-a85c-1e83565ac90c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:19.846225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ec111-cb00-4eb5-a85c-1e83565ac90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:19.884674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-dd4ec111-cb00-4eb5-a85c-1e83565ac90c None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:19.890579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dd4ec111-cb00-4eb5-a85c-1e83565ac90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:19.911290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 813/1642] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 12 18:59:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:19.917128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1b1d9-fd5b-457e-8d4b-3e821f41bcd8 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:19.917432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1b1d9-fd5b-457e-8d4b-3e821f41bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:19.917760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1b1d9-fd5b-457e-8d4b-3e821f41bcd8 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:19.919584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 830/1643] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 12 18:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:59:19.924956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50dc35-0add-4981-911d-639ff883eee4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:19.925250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50dc35-0add-4981-911d-639ff883eee4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:19.926238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50dc35-0add-4981-911d-639ff883eee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:19.949052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-cd50dc35-0add-4981-911d-639ff883eee4 None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:19.951637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cd50dc35-0add-4981-911d-639ff883eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:19.971851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 814/1644] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 18:59:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:19.988416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1b1d9-fd5b-457e-8d4b-3e821f41bcd8 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:20.008395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1b1d9-fd5b-457e-8d4b-3e821f41bcd8 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:20.026585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed8df9-32f3-457e-8067-81f39e6af222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:20.027603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed8df9-32f3-457e-8067-81f39e6af222 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:20.028056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed8df9-32f3-457e-8067-81f39e6af222 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:20.029133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed8df9-32f3-457e-8067-81f39e6af222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:20.044321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed8df9-32f3-457e-8067-81f39e6af222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:20.060535 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed8df9-32f3-457e-8067-81f39e6af222 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:20.106545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 831/1645] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:20.271475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705142d-790e-4987-aed6-1818d07e12fa None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:20.272447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705142d-790e-4987-aed6-1818d07e12fa None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:20.272832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705142d-790e-4987-aed6-1818d07e12fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:20.333250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6705142d-790e-4987-aed6-1818d07e12fa None None] MFA Rules not processed for user `6dfc6f930dea4e83a4fc58c9b02276f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:20.335850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6705142d-790e-4987-aed6-1818d07e12fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:20.448247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 815/1646] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:20.462723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707a229-2c9d-4bba-a84e-3b1b4dd8e8ae None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:20.463484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707a229-2c9d-4bba-a84e-3b1b4dd8e8ae None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:20.463484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707a229-2c9d-4bba-a84e-3b1b4dd8e8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:20.484573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4707a229-2c9d-4bba-a84e-3b1b4dd8e8ae None None] MFA Rules not processed for user `6dfc6f930dea4e83a4fc58c9b02276f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:20.485990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4707a229-2c9d-4bba-a84e-3b1b4dd8e8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:20.503205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 832/1647] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:20.510901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705142d-790e-4987-aed6-1818d07e12fa None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:20.526122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705142d-790e-4987-aed6-1818d07e12fa None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:20.542925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabba767-fcc9-4f2a-bc4e-a383e0ff1ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:20.543940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabba767-fcc9-4f2a-bc4e-a383e0ff1ea6 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:20.544618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabba767-fcc9-4f2a-bc4e-a383e0ff1ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:20.545062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabba767-fcc9-4f2a-bc4e-a383e0ff1ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:20.567337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabba767-fcc9-4f2a-bc4e-a383e0ff1ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:20.569514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabba767-fcc9-4f2a-bc4e-a383e0ff1ea6 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:20.597001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 816/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:21.287933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707a229-2c9d-4bba-a84e-3b1b4dd8e8ae None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:21.429768 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707a229-2c9d-4bba-a84e-3b1b4dd8e8ae None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:21.444506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:21.445401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:21.445760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:21.446103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] PATH_INFO: `/v3/users/7f9d8187e531469faee011dbbf87075a` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:21.447487 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9d8187e531469faee011dbbf87075a)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:21.449451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: WARNING py.warnings [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:59:21.449451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: warnings.warn(msg) May 12 18:59:21.449451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: May 12 18:59:21.450923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:21.627689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9d8187e531469faee011dbbf87075a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:21.628391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9d8187e531469faee011dbbf87075a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:21.663226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9d8187e531469faee011dbbf87075a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:21.665868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9d8187e531469faee011dbbf87075a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:21.682439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4fffb011-644c-47ec-bd69-929045888049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9d8187e531469faee011dbbf87075a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:21.719745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 833/1649] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:59:21 2022] DELETE /identity/v3/users/7f9d8187e531469faee011dbbf87075a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:21.723520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d926-c206-427d-b2a0-807d01721abb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:21.729906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d926-c206-427d-b2a0-807d01721abb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:21.732687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d926-c206-427d-b2a0-807d01721abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:21.746125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6d84-e474-4a0c-af47-c89d42d715b0 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:21.746415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6d84-e474-4a0c-af47-c89d42d715b0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:21.747284 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6d84-e474-4a0c-af47-c89d42d715b0 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:21.748678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 834/1650] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 12 18:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:59:21.754891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c56e1-1193-41d9-b9b6-a415fdb654de None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:21.755246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c56e1-1193-41d9-b9b6-a415fdb654de None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:21.755547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c56e1-1193-41d9-b9b6-a415fdb654de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:21.759454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-5a56d926-c206-427d-b2a0-807d01721abb None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:21.760952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5a56d926-c206-427d-b2a0-807d01721abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:21.848519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-da9c56e1-1193-41d9-b9b6-a415fdb654de None None] MFA Rules not processed for user `41938583e61a45398e3e284c70204292`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:21.858378 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-da9c56e1-1193-41d9-b9b6-a415fdb654de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:21.864484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 817/1651] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:21.922828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d926-c206-427d-b2a0-807d01721abb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:21.927092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5a56d926-c206-427d-b2a0-807d01721abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:21.988647 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 835/1652] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 18:59:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:22.040211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c56e1-1193-41d9-b9b6-a415fdb654de None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:22.042622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-da9c56e1-1193-41d9-b9b6-a415fdb654de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:22.061826 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c56e1-1193-41d9-b9b6-a415fdb654de None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:22.084012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d926-c206-427d-b2a0-807d01721abb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:22.088235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f11c8-6efc-4559-b73d-05a5bdd79728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:22.090502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f11c8-6efc-4559-b73d-05a5bdd79728 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:22.091112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f11c8-6efc-4559-b73d-05a5bdd79728 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:22.093086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ddd87-1a3e-4d27-a25e-22d1e42389a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:22.093685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f11c8-6efc-4559-b73d-05a5bdd79728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:22.106134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddd87-1a3e-4d27-a25e-22d1e42389a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:22.106496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddd87-1a3e-4d27-a25e-22d1e42389a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:22.107754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddd87-1a3e-4d27-a25e-22d1e42389a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:22.127474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f11c8-6efc-4559-b73d-05a5bdd79728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:22.133714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f11c8-6efc-4559-b73d-05a5bdd79728 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:22.145299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ddd87-1a3e-4d27-a25e-22d1e42389a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:22.151329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ddd87-1a3e-4d27-a25e-22d1e42389a0 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:22.174290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 836/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:59:22.190139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 818/1654] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:22.744423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f11c8-6efc-4559-b73d-05a5bdd79728 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:22.744423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-556f11c8-6efc-4559-b73d-05a5bdd79728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:22.766482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f11c8-6efc-4559-b73d-05a5bdd79728 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:22.774426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:22.775849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:22.775849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:22.776783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] PATH_INFO: `/v3/users/3d23a659c657413dbb7d438077f8af03` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:22.793330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d23a659c657413dbb7d438077f8af03)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:22.816818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:22.927202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d23a659c657413dbb7d438077f8af03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:22.928406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d23a659c657413dbb7d438077f8af03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:22.941850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d23a659c657413dbb7d438077f8af03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:22.942952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d23a659c657413dbb7d438077f8af03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:22.955889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d23a659c657413dbb7d438077f8af03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:22.984500 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 837/1655] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:59:22 2022] DELETE /identity/v3/users/3d23a659c657413dbb7d438077f8af03 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:22.984754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eb574-c862-4a45-bf9d-100bc84dc2aa None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:22.985176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eb574-c862-4a45-bf9d-100bc84dc2aa None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:22.985347 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eb574-c862-4a45-bf9d-100bc84dc2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:23.005264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b47eb574-c862-4a45-bf9d-100bc84dc2aa None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:23.014425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b47eb574-c862-4a45-bf9d-100bc84dc2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:23.123871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 819/1656] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:23.206313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:23.212074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:23.344545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b45fb-29c1-444f-b1ad-e80623204e78 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:23.353553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2390576-6302-457e-bd61-2894d3f3fc59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:23.353761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390576-6302-457e-bd61-2894d3f3fc59 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:23.354011 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390576-6302-457e-bd61-2894d3f3fc59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:23.354580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390576-6302-457e-bd61-2894d3f3fc59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:23.366946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2390576-6302-457e-bd61-2894d3f3fc59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:23.369307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2390576-6302-457e-bd61-2894d3f3fc59 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:23.396049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 838/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:24.403087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ebc57-135f-4e15-a09d-8ece66849929 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:24.403916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ebc57-135f-4e15-a09d-8ece66849929 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:24.404339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ebc57-135f-4e15-a09d-8ece66849929 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:24.406203 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 820/1658] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 12 18:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:59:24.413623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e73cb5-7428-4d7c-86d7-402003dbdf7f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:24.417026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e73cb5-7428-4d7c-86d7-402003dbdf7f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:24.417562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e73cb5-7428-4d7c-86d7-402003dbdf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:24.442074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-94e73cb5-7428-4d7c-86d7-402003dbdf7f None None] MFA Rules not processed for user `cf772e34d8f14923bb9c1fe883fd3926`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:24.444132 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-94e73cb5-7428-4d7c-86d7-402003dbdf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:24.652240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 839/1659] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 12 18:59:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:24.660621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ebc57-135f-4e15-a09d-8ece66849929 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:24.683383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ebc57-135f-4e15-a09d-8ece66849929 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:24.694243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf772e34d8f14923bb9c1fe883fd3926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:24.694916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:24.695201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:24.695480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:24.700412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:24.732172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:24.733814 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:24.757222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 821/1660] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:24.858109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e73cb5-7428-4d7c-86d7-402003dbdf7f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:24.859931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-94e73cb5-7428-4d7c-86d7-402003dbdf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:24.884450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:24.886086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:24.907662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e73cb5-7428-4d7c-86d7-402003dbdf7f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:24.917858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e750048-a4fa-4b1c-9659-72fe405a27ca service placement] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:24.929162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:24.930061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:24.930347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:24.930625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] PATH_INFO: `/v3/projects/e919eefce93845b8bbd05ebb732096db` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:24.947512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:24.948408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:24.948691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:24.948969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] PATH_INFO: `/v3/projects/4517de5071714dd9928b56103b14efcf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:24.949687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e919eefce93845b8bbd05ebb732096db)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:24.952748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:24.956374 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4517de5071714dd9928b56103b14efcf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:24.963379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: WARNING py.warnings [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 18:59:24.963379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: warnings.warn(msg) May 12 18:59:24.963379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: May 12 18:59:24.964616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:25.118468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e919eefce93845b8bbd05ebb732096db', 'request_id': 'req-79de0016-9b71-4d77-ba55-2eaf3a03cad4'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.149939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e919eefce93845b8bbd05ebb732096db', 'request_id': 'req-79de0016-9b71-4d77-ba55-2eaf3a03cad4'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.162959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e919eefce93845b8bbd05ebb732096db', 'request_id': 'req-79de0016-9b71-4d77-ba55-2eaf3a03cad4'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.168240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4517de5071714dd9928b56103b14efcf', 'request_id': 'req-40cdacd5-263d-4537-810a-9f29d419601c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.184839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4517de5071714dd9928b56103b14efcf', 'request_id': 'req-40cdacd5-263d-4537-810a-9f29d419601c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.194592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] The token cache is being invalidate because project e919eefce93845b8bbd05ebb732096db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 18:59:25.194886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.195577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-79de0016-9b71-4d77-ba55-2eaf3a03cad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.196104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4517de5071714dd9928b56103b14efcf', 'request_id': 'req-40cdacd5-263d-4537-810a-9f29d419601c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.200491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 840/1661] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 18:59:24 2022] DELETE /identity/v3/projects/e919eefce93845b8bbd05ebb732096db => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:25.201889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0636dc6-0b47-4295-86ec-5f62d1766131 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:25.202178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0636dc6-0b47-4295-86ec-5f62d1766131 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:25.202453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0636dc6-0b47-4295-86ec-5f62d1766131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:25.257505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c0636dc6-0b47-4295-86ec-5f62d1766131 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:25.262177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] The token cache is being invalidate because project 4517de5071714dd9928b56103b14efcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 18:59:25.262764 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.263940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.265742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c0636dc6-0b47-4295-86ec-5f62d1766131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:25.266886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 822/1662] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 18:59:24 2022] DELETE /identity/v3/projects/4517de5071714dd9928b56103b14efcf => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:25.270957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:25.273039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:25.444351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 841/1663] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:25.452090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020a59-c827-47ae-a9b9-8c05aa164316 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:25.452380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020a59-c827-47ae-a9b9-8c05aa164316 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:25.452821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020a59-c827-47ae-a9b9-8c05aa164316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:25.457613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdacd5-263d-4537-810a-9f29d419601c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:25.476811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:25.478852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:25.479318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:25.479748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] PATH_INFO: `/v3/users/7f0c9efe65a6460e84ee73136c63fd9b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:25.482807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0c9efe65a6460e84ee73136c63fd9b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:25.487439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:25.491720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2f020a59-c827-47ae-a9b9-8c05aa164316 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:25.492974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2f020a59-c827-47ae-a9b9-8c05aa164316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:25.511670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 842/1664] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:25.515463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f020a59-c827-47ae-a9b9-8c05aa164316 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:25.534197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f020a59-c827-47ae-a9b9-8c05aa164316 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:25.562504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03757c35-2869-4b48-828e-069cd52392ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:25.563210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03757c35-2869-4b48-828e-069cd52392ce admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:25.563545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03757c35-2869-4b48-828e-069cd52392ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:25.563983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03757c35-2869-4b48-828e-069cd52392ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:25.564870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03757c35-2869-4b48-828e-069cd52392ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:25.565323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03757c35-2869-4b48-828e-069cd52392ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:25.567293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03757c35-2869-4b48-828e-069cd52392ce admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:25.604603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0c9efe65a6460e84ee73136c63fd9b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.610460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 843/1665] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:25.611446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03757c35-2869-4b48-828e-069cd52392ce admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:25.625200 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03757c35-2869-4b48-828e-069cd52392ce admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:25.648837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767591-d7af-476d-8f61-4b1ae98ea29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:25.649817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767591-d7af-476d-8f61-4b1ae98ea29a admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:25.650151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0c9efe65a6460e84ee73136c63fd9b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.650408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767591-d7af-476d-8f61-4b1ae98ea29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:25.650849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767591-d7af-476d-8f61-4b1ae98ea29a admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:25.651692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4767591-d7af-476d-8f61-4b1ae98ea29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:25.653810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4767591-d7af-476d-8f61-4b1ae98ea29a admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:25.684115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0c9efe65a6460e84ee73136c63fd9b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.688438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0c9efe65a6460e84ee73136c63fd9b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.701264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0c9efe65a6460e84ee73136c63fd9b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:25.721507 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 823/1666] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:59:25 2022] DELETE /identity/v3/users/7f0c9efe65a6460e84ee73136c63fd9b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:25.739113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 844/1667] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:25 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:25.743746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:25.745667 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:25.982578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16517ee-dc83-4ad8-b291-0b54342e359c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:26.163633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f0285-d4ba-4af3-9fb9-fd82c2171c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:26.165765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f0285-d4ba-4af3-9fb9-fd82c2171c0f admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:26.170655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f0285-d4ba-4af3-9fb9-fd82c2171c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:26.171135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f0285-d4ba-4af3-9fb9-fd82c2171c0f admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:26.172268 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f0285-d4ba-4af3-9fb9-fd82c2171c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:26.174999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f0285-d4ba-4af3-9fb9-fd82c2171c0f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:26.227992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 824/1668] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:25 2022] POST /identity/v3/users => generated 287 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:26.228798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767591-d7af-476d-8f61-4b1ae98ea29a admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:26.243919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767591-d7af-476d-8f61-4b1ae98ea29a admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:26.274321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37852a44-915e-4021-955f-5b5b528e34d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:26.275268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37852a44-915e-4021-955f-5b5b528e34d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:26.275665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37852a44-915e-4021-955f-5b5b528e34d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:26.276052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37852a44-915e-4021-955f-5b5b528e34d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:26.276962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37852a44-915e-4021-955f-5b5b528e34d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:26.281515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37852a44-915e-4021-955f-5b5b528e34d5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:26.325060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 845/1669] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 18:59:26.326511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f0285-d4ba-4af3-9fb9-fd82c2171c0f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:26.340514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f0285-d4ba-4af3-9fb9-fd82c2171c0f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:26.360893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5405f51-a489-4d5e-958a-6d894fe500b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:26.362409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5405f51-a489-4d5e-958a-6d894fe500b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:26.362817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5405f51-a489-4d5e-958a-6d894fe500b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:26.363204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5405f51-a489-4d5e-958a-6d894fe500b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:26.364905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5405f51-a489-4d5e-958a-6d894fe500b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:26.367897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5405f51-a489-4d5e-958a-6d894fe500b8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:26.396153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37852a44-915e-4021-955f-5b5b528e34d5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:26.397746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 825/1670] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:26.413837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37852a44-915e-4021-955f-5b5b528e34d5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:26.423606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e29d5-1c7c-4762-b7aa-834e6e070cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:26.424953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e29d5-1c7c-4762-b7aa-834e6e070cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:26.425386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e29d5-1c7c-4762-b7aa-834e6e070cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:26.425828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e29d5-1c7c-4762-b7aa-834e6e070cfa admin admin] PATH_INFO: `/v3/projects/73241efbb4d6484b93830c9a3797f925/users/88ac5f3b1be04fd4875be5dee14ba7f8/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:26.460240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e29d5-1c7c-4762-b7aa-834e6e070cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=73241efbb4d6484b93830c9a3797f925, user_id=88ac5f3b1be04fd4875be5dee14ba7f8, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:26.464636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e29d5-1c7c-4762-b7aa-834e6e070cfa admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:26.492218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 846/1671] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:26 2022] PUT /identity/v3/projects/73241efbb4d6484b93830c9a3797f925/users/88ac5f3b1be04fd4875be5dee14ba7f8/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:59:26.503191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f3565-816e-4532-8793-620897e95a40 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:26.504092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f3565-816e-4532-8793-620897e95a40 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:26.504516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f3565-816e-4532-8793-620897e95a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:26.561267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-560f3565-816e-4532-8793-620897e95a40 None None] MFA Rules not processed for user `88ac5f3b1be04fd4875be5dee14ba7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:26.563291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-560f3565-816e-4532-8793-620897e95a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:26.572341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b662-ca53-4bc0-be06-c089c980fd33 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:26.572628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b662-ca53-4bc0-be06-c089c980fd33 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:26.573076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b662-ca53-4bc0-be06-c089c980fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:26.689700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-cfd4b662-ca53-4bc0-be06-c089c980fd33 None None] MFA Rules not processed for user `2c202a7f2c484cd3b0363b75c1a673a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:26.691308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-cfd4b662-ca53-4bc0-be06-c089c980fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:26.704961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 826/1672] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:26.717785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f3565-816e-4532-8793-620897e95a40 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:26.720181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-560f3565-816e-4532-8793-620897e95a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:26.941969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f3565-816e-4532-8793-620897e95a40 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:26.954834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b06db1-3348-4a24-96a5-ba8b1521dd46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:26.963621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06db1-3348-4a24-96a5-ba8b1521dd46 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:26.966420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06db1-3348-4a24-96a5-ba8b1521dd46 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:26.967696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06db1-3348-4a24-96a5-ba8b1521dd46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:27.004931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b06db1-3348-4a24-96a5-ba8b1521dd46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:27.008930 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b06db1-3348-4a24-96a5-ba8b1521dd46 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:27.034165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 827/1673] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:27.309277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 847/1674] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 738 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:27.325557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b06db1-3348-4a24-96a5-ba8b1521dd46 service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:27.328348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e5b06db1-3348-4a24-96a5-ba8b1521dd46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:27.368427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b06db1-3348-4a24-96a5-ba8b1521dd46 service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:27.383764 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8afc02-1cf1-4dec-817f-d754241a4328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:27.386138 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8afc02-1cf1-4dec-817f-d754241a4328 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:27.386549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8afc02-1cf1-4dec-817f-d754241a4328 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:27.386968 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8afc02-1cf1-4dec-817f-d754241a4328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:27.403775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8afc02-1cf1-4dec-817f-d754241a4328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:27.408785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8afc02-1cf1-4dec-817f-d754241a4328 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:27.435753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 828/1675] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:27.453198 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b662-ca53-4bc0-be06-c089c980fd33 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:27.578335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b662-ca53-4bc0-be06-c089c980fd33 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:27.593770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:27.598544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:27.599083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:27.600649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] PATH_INFO: `/v3/users/88ac5f3b1be04fd4875be5dee14ba7f8` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:27.603348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ac5f3b1be04fd4875be5dee14ba7f8)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:27.609252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:27.757802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ac5f3b1be04fd4875be5dee14ba7f8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:27.759177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ac5f3b1be04fd4875be5dee14ba7f8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:27.786000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ac5f3b1be04fd4875be5dee14ba7f8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:27.787911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ac5f3b1be04fd4875be5dee14ba7f8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:27.806070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ac5f3b1be04fd4875be5dee14ba7f8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:27.848837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 848/1676] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:59:27 2022] DELETE /identity/v3/users/88ac5f3b1be04fd4875be5dee14ba7f8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:27.853346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60983743-b51c-4624-a89d-c9a0e6310d61 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:27.853910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60983743-b51c-4624-a89d-c9a0e6310d61 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:27.854165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60983743-b51c-4624-a89d-c9a0e6310d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:27.921902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-60983743-b51c-4624-a89d-c9a0e6310d61 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:27.923156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-60983743-b51c-4624-a89d-c9a0e6310d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:28.035526 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 829/1677] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:28.120682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:28.122579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:28.174593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60983743-b51c-4624-a89d-c9a0e6310d61 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:28.176400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-60983743-b51c-4624-a89d-c9a0e6310d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:28.199077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60983743-b51c-4624-a89d-c9a0e6310d61 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:28.210975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:28.212215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:28.212667 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:28.213117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] PATH_INFO: `/v3/projects/964fa4f36371418f9f9e93b6ffddc225` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:28.214583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=964fa4f36371418f9f9e93b6ffddc225)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:28.216519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:28.300319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e241-1190-42e4-8d6d-fe4094a50cef admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:28.314538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c47290-a9cd-4473-ab16-ba5487b99324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:28.315223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c47290-a9cd-4473-ab16-ba5487b99324 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:28.315503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c47290-a9cd-4473-ab16-ba5487b99324 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:28.316544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c47290-a9cd-4473-ab16-ba5487b99324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:28.346921 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c47290-a9cd-4473-ab16-ba5487b99324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:28.349240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c47290-a9cd-4473-ab16-ba5487b99324 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:28.373478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 849/1678] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:28.386279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f46f9c-2beb-439b-934d-5a1f4f2879b8 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:28.386772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f46f9c-2beb-439b-934d-5a1f4f2879b8 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:28.387064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f46f9c-2beb-439b-934d-5a1f4f2879b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:28.414206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '964fa4f36371418f9f9e93b6ffddc225', 'request_id': 'req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:28.441757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-83f46f9c-2beb-439b-934d-5a1f4f2879b8 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:28.444050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '964fa4f36371418f9f9e93b6ffddc225', 'request_id': 'req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:28.444925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-83f46f9c-2beb-439b-934d-5a1f4f2879b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:28.451017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '964fa4f36371418f9f9e93b6ffddc225', 'request_id': 'req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:28.472181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] The token cache is being invalidate because project 964fa4f36371418f9f9e93b6ffddc225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 18:59:28.472487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:28.473950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d4e24aa7-eeff-4623-a815-b0dd72b41ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:28.482397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 830/1679] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 18:59:28 2022] DELETE /identity/v3/projects/964fa4f36371418f9f9e93b6ffddc225 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:28.484083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb987a-9c11-43ec-8b46-08f9ad6b796a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:28.484362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb987a-9c11-43ec-8b46-08f9ad6b796a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:28.484638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb987a-9c11-43ec-8b46-08f9ad6b796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:28.522132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6aeb987a-9c11-43ec-8b46-08f9ad6b796a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:28.523574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6aeb987a-9c11-43ec-8b46-08f9ad6b796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:28.568746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 850/1680] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:28.678823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 831/1681] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:28.685676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26ed8d-8916-45c7-896b-b3e56a7755c9 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:28.686638 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26ed8d-8916-45c7-896b-b3e56a7755c9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:28.687327 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26ed8d-8916-45c7-896b-b3e56a7755c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:28.722395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-fc26ed8d-8916-45c7-896b-b3e56a7755c9 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:28.725385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fc26ed8d-8916-45c7-896b-b3e56a7755c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:28.737245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 851/1682] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:28.742246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb987a-9c11-43ec-8b46-08f9ad6b796a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:28.756589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb987a-9c11-43ec-8b46-08f9ad6b796a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:28.770895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e00d71-dddf-4f08-9baf-ae04a71a4919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:28.771926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e00d71-dddf-4f08-9baf-ae04a71a4919 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:28.773215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26ed8d-8916-45c7-896b-b3e56a7755c9 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:28.775738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fc26ed8d-8916-45c7-896b-b3e56a7755c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:28.782875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e00d71-dddf-4f08-9baf-ae04a71a4919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:28.785007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e00d71-dddf-4f08-9baf-ae04a71a4919 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:28.789715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e00d71-dddf-4f08-9baf-ae04a71a4919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:28.790766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e00d71-dddf-4f08-9baf-ae04a71a4919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:28.796737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e00d71-dddf-4f08-9baf-ae04a71a4919 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:28.825505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 832/1683] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:28.832811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e00d71-dddf-4f08-9baf-ae04a71a4919 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:28.873841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e00d71-dddf-4f08-9baf-ae04a71a4919 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:28.891535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c523e-8d4c-463a-b162-5235cafa7b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:28.894594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c523e-8d4c-463a-b162-5235cafa7b52 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:28.895078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c523e-8d4c-463a-b162-5235cafa7b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:28.895506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c523e-8d4c-463a-b162-5235cafa7b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:28.897028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c523e-8d4c-463a-b162-5235cafa7b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:28.903982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c523e-8d4c-463a-b162-5235cafa7b52 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:28.988569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 833/1684] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:28 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:59:28.992083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c523e-8d4c-463a-b162-5235cafa7b52 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:28.999537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26ed8d-8916-45c7-896b-b3e56a7755c9 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:29.232374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c28bb-e923-4541-8e24-368f66d9d1df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:29.235563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c28bb-e923-4541-8e24-368f66d9d1df service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:29.235736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c28bb-e923-4541-8e24-368f66d9d1df service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:29.237474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c28bb-e923-4541-8e24-368f66d9d1df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:29.264510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c523e-8d4c-463a-b162-5235cafa7b52 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:29.275028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d016-7cf5-4474-859c-cc257b58d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:29.276543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d016-7cf5-4474-859c-cc257b58d856 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:29.277034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d016-7cf5-4474-859c-cc257b58d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:29.279655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d016-7cf5-4474-859c-cc257b58d856 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:29.282191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d016-7cf5-4474-859c-cc257b58d856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:29.291600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d016-7cf5-4474-859c-cc257b58d856 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:29.337441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 834/1685] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:28 2022] POST /identity/v3/users => generated 294 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:29.338643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d016-7cf5-4474-859c-cc257b58d856 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:29.351243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d016-7cf5-4474-859c-cc257b58d856 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:29.364915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fec3-0e6d-4adf-af17-2c8dabbed860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:29.365958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fec3-0e6d-4adf-af17-2c8dabbed860 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:29.370343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fec3-0e6d-4adf-af17-2c8dabbed860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:29.378088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fec3-0e6d-4adf-af17-2c8dabbed860 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:29.379613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25fec3-0e6d-4adf-af17-2c8dabbed860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:29.383004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25fec3-0e6d-4adf-af17-2c8dabbed860 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:29.410617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 835/1686] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:29.412169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fec3-0e6d-4adf-af17-2c8dabbed860 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:29.422974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c28bb-e923-4541-8e24-368f66d9d1df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:29.424764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c28bb-e923-4541-8e24-368f66d9d1df service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:29.428919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fec3-0e6d-4adf-af17-2c8dabbed860 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:29.438691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95d0cd-f508-466a-86ff-a4581959775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:29.439625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95d0cd-f508-466a-86ff-a4581959775a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:29.440190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95d0cd-f508-466a-86ff-a4581959775a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:29.440339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95d0cd-f508-466a-86ff-a4581959775a admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:29.441362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95d0cd-f508-466a-86ff-a4581959775a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:29.443780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95d0cd-f508-466a-86ff-a4581959775a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:29.463916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 836/1687] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:29.465067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95d0cd-f508-466a-86ff-a4581959775a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:29.478174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 852/1688] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 18:59:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 18:59:29.480155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95d0cd-f508-466a-86ff-a4581959775a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:29.540356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141def0-5ca2-400f-a642-7d6777301a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:29.541417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141def0-5ca2-400f-a642-7d6777301a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:29.546813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141def0-5ca2-400f-a642-7d6777301a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:29.547150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141def0-5ca2-400f-a642-7d6777301a39 admin admin] PATH_INFO: `/v3/projects/1e3f8901b91b4fa3b751e1af2c5806ec/users/b224ccee53854a5ead02b82ab01304e3/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:29.604059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141def0-5ca2-400f-a642-7d6777301a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3f8901b91b4fa3b751e1af2c5806ec, user_id=b224ccee53854a5ead02b82ab01304e3, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:29.609325 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141def0-5ca2-400f-a642-7d6777301a39 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:29.664673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 837/1689] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:29 2022] PUT /identity/v3/projects/1e3f8901b91b4fa3b751e1af2c5806ec/users/b224ccee53854a5ead02b82ab01304e3/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:29.675669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a718f8-c932-465f-96ca-5e98eeee8063 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:29.678382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a718f8-c932-465f-96ca-5e98eeee8063 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:29.679704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a718f8-c932-465f-96ca-5e98eeee8063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:29.786921 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-53a718f8-c932-465f-96ca-5e98eeee8063 None None] MFA Rules not processed for user `b224ccee53854a5ead02b82ab01304e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:29.800041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-53a718f8-c932-465f-96ca-5e98eeee8063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:30.008688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 853/1690] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:30.013624 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141def0-5ca2-400f-a642-7d6777301a39 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:30.230847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141def0-5ca2-400f-a642-7d6777301a39 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:30.247527 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da34fc-e7f1-44e4-9e3f-8bae69d7d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:30.248426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da34fc-e7f1-44e4-9e3f-8bae69d7d9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:30.248806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da34fc-e7f1-44e4-9e3f-8bae69d7d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:30.249129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da34fc-e7f1-44e4-9e3f-8bae69d7d9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:30.249982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da34fc-e7f1-44e4-9e3f-8bae69d7d9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:30.252301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da34fc-e7f1-44e4-9e3f-8bae69d7d9f7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:30.384997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 838/1691] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:30 2022] POST /identity/v3/projects => generated 387 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:30.390870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a718f8-c932-465f-96ca-5e98eeee8063 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:30.438079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a718f8-c932-465f-96ca-5e98eeee8063 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:30.728985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389e77f-e851-4382-a676-ccd8cebd6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:30.729703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389e77f-e851-4382-a676-ccd8cebd6837 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:30.729986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389e77f-e851-4382-a676-ccd8cebd6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:30.730261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389e77f-e851-4382-a676-ccd8cebd6837 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:30.730956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389e77f-e851-4382-a676-ccd8cebd6837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:30.740339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389e77f-e851-4382-a676-ccd8cebd6837 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:30.819439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 854/1692] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:30 2022] POST /identity/v3/users => generated 300 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:30.823962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da34fc-e7f1-44e4-9e3f-8bae69d7d9f7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:30.837174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da34fc-e7f1-44e4-9e3f-8bae69d7d9f7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:30.864664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59c43-b75e-431f-926e-1a979284da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:30.865805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59c43-b75e-431f-926e-1a979284da89 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:30.866341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59c43-b75e-431f-926e-1a979284da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:30.870023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59c43-b75e-431f-926e-1a979284da89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:30.872600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c59c43-b75e-431f-926e-1a979284da89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:30.879072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c59c43-b75e-431f-926e-1a979284da89 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:30.923894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389e77f-e851-4382-a676-ccd8cebd6837 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:30.925337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 839/1693] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:30.951307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389e77f-e851-4382-a676-ccd8cebd6837 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:30.987052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2a54c-83cc-4d32-9ec2-45fc1d00a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:30.987052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2a54c-83cc-4d32-9ec2-45fc1d00a56b admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:30.987052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2a54c-83cc-4d32-9ec2-45fc1d00a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:30.987052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2a54c-83cc-4d32-9ec2-45fc1d00a56b admin admin] PATH_INFO: `/v3/projects/ff1fd96d2fab4215abd8bfd8b97d64d3/users/d34a56c80a6b41b592c5d4ef0e764c2a/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:31.083580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2a54c-83cc-4d32-9ec2-45fc1d00a56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1fd96d2fab4215abd8bfd8b97d64d3, user_id=d34a56c80a6b41b592c5d4ef0e764c2a, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:31.086850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2a54c-83cc-4d32-9ec2-45fc1d00a56b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:31.164909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 855/1694] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:30 2022] PUT /identity/v3/projects/ff1fd96d2fab4215abd8bfd8b97d64d3/users/d34a56c80a6b41b592c5d4ef0e764c2a/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:31.165087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59c43-b75e-431f-926e-1a979284da89 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:31.187950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59c43-b75e-431f-926e-1a979284da89 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:31.341841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd920f08-6706-408b-84e1-0b29328d3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:31.342971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920f08-6706-408b-84e1-0b29328d3957 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:31.344668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920f08-6706-408b-84e1-0b29328d3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:31.345095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920f08-6706-408b-84e1-0b29328d3957 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:31.346409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd920f08-6706-408b-84e1-0b29328d3957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:31.349862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd920f08-6706-408b-84e1-0b29328d3957 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:31.379056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 840/1695] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:31.383594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2a54c-83cc-4d32-9ec2-45fc1d00a56b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:31.399321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2a54c-83cc-4d32-9ec2-45fc1d00a56b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:31.414215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2a131-4844-409e-9974-7e1137f526ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:31.415513 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2a131-4844-409e-9974-7e1137f526ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:31.415999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2a131-4844-409e-9974-7e1137f526ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:31.416515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2a131-4844-409e-9974-7e1137f526ab admin admin] PATH_INFO: `/v3/projects/ff1fd96d2fab4215abd8bfd8b97d64d3/users/d34a56c80a6b41b592c5d4ef0e764c2a/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:31.427212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2a131-4844-409e-9974-7e1137f526ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1fd96d2fab4215abd8bfd8b97d64d3, user_id=d34a56c80a6b41b592c5d4ef0e764c2a, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:31.431023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2a131-4844-409e-9974-7e1137f526ab admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:31.457368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 856/1696] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:31 2022] PUT /identity/v3/projects/ff1fd96d2fab4215abd8bfd8b97d64d3/users/d34a56c80a6b41b592c5d4ef0e764c2a/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:31.468819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad490ae-43c4-4e59-88cc-61c8be09e95e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:31.469649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad490ae-43c4-4e59-88cc-61c8be09e95e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:31.470421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad490ae-43c4-4e59-88cc-61c8be09e95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:31.547698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1ad490ae-43c4-4e59-88cc-61c8be09e95e None None] MFA Rules not processed for user `d34a56c80a6b41b592c5d4ef0e764c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:31.549377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1ad490ae-43c4-4e59-88cc-61c8be09e95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:31.711762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 841/1697] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:31.736563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2a131-4844-409e-9974-7e1137f526ab admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:31.738357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bdb2a131-4844-409e-9974-7e1137f526ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:31.868191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2a131-4844-409e-9974-7e1137f526ab admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:31.878261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd1fdd-e766-4759-85ff-7b284c679ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:31.878979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd1fdd-e766-4759-85ff-7b284c679ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:31.879314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd1fdd-e766-4759-85ff-7b284c679ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:31.879593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd1fdd-e766-4759-85ff-7b284c679ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:31.882446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad490ae-43c4-4e59-88cc-61c8be09e95e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:31.883918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1ad490ae-43c4-4e59-88cc-61c8be09e95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:31.921519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd1fdd-e766-4759-85ff-7b284c679ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:31.923019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd1fdd-e766-4759-85ff-7b284c679ed9 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:31.973591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 857/1698] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:32.084389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd1fdd-e766-4759-85ff-7b284c679ed9 service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:32.088226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad490ae-43c4-4e59-88cc-61c8be09e95e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:32.095232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:32.096882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:32.097855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:32.098296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] PATH_INFO: `/v3/projects/73241efbb4d6484b93830c9a3797f925` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:32.100451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73241efbb4d6484b93830c9a3797f925)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:32.100575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd1fdd-e766-4759-85ff-7b284c679ed9 service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:32.102894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:32.133867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:32.134831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:32.135109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:32.135573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] PATH_INFO: `/v3/users/b224ccee53854a5ead02b82ab01304e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:32.138446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b224ccee53854a5ead02b82ab01304e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:32.144554 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:32.238928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b224ccee53854a5ead02b82ab01304e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.240527 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b224ccee53854a5ead02b82ab01304e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.275618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b224ccee53854a5ead02b82ab01304e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.276398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b224ccee53854a5ead02b82ab01304e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.287918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3dcc78e1-8313-402d-ba10-44ed1cbcaee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b224ccee53854a5ead02b82ab01304e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.288919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73241efbb4d6484b93830c9a3797f925', 'request_id': 'req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.303133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73241efbb4d6484b93830c9a3797f925', 'request_id': 'req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.319386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 858/1699] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:59:32 2022] DELETE /identity/v3/users/b224ccee53854a5ead02b82ab01304e3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:32.323885 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7d052-c7c2-4d2c-89a8-427b8a766068 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:32.324288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7d052-c7c2-4d2c-89a8-427b8a766068 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:32.324728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7d052-c7c2-4d2c-89a8-427b8a766068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:32.331301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73241efbb4d6484b93830c9a3797f925', 'request_id': 'req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.350538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] The token cache is being invalidate because project 73241efbb4d6484b93830c9a3797f925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 18:59:32.350833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.351510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ff9ac0c1-f5a3-4b62-985e-a67089bf5094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:32.353461 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 842/1700] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 18:59:31 2022] DELETE /identity/v3/projects/73241efbb4d6484b93830c9a3797f925 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:32.358679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9ef28-400e-47d4-9e9b-c9aa2d376dd3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:32.359412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9ef28-400e-47d4-9e9b-c9aa2d376dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:32.360668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9ef28-400e-47d4-9e9b-c9aa2d376dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:32.370835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6ee7d052-c7c2-4d2c-89a8-427b8a766068 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:32.372266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6ee7d052-c7c2-4d2c-89a8-427b8a766068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:32.413462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6de9ef28-400e-47d4-9e9b-c9aa2d376dd3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:32.415783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6de9ef28-400e-47d4-9e9b-c9aa2d376dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:32.545618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 843/1701] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:32.553935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 859/1702] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:32.562014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d184f6-2d47-43ce-bef5-65c51360be28 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:32.562694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d184f6-2d47-43ce-bef5-65c51360be28 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:32.562694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d184f6-2d47-43ce-bef5-65c51360be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:32.606212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-27d184f6-2d47-43ce-bef5-65c51360be28 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:32.620173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-27d184f6-2d47-43ce-bef5-65c51360be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:32.646255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 844/1703] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:32.647467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7d052-c7c2-4d2c-89a8-427b8a766068 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:32.686281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7d052-c7c2-4d2c-89a8-427b8a766068 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:32.706645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03428196-93c1-4aed-9ecb-a25c310a413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:32.707680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03428196-93c1-4aed-9ecb-a25c310a413b admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:32.708184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03428196-93c1-4aed-9ecb-a25c310a413b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:32.708647 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03428196-93c1-4aed-9ecb-a25c310a413b admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:32.709646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03428196-93c1-4aed-9ecb-a25c310a413b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:32.710114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03428196-93c1-4aed-9ecb-a25c310a413b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:32.713237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03428196-93c1-4aed-9ecb-a25c310a413b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:32.718376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d184f6-2d47-43ce-bef5-65c51360be28 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:32.719910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-27d184f6-2d47-43ce-bef5-65c51360be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:32.766645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 860/1704] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:32.769024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03428196-93c1-4aed-9ecb-a25c310a413b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:32.813979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03428196-93c1-4aed-9ecb-a25c310a413b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:32.840848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e3d60-79c7-404a-9436-c611ebd19950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:32.842379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e3d60-79c7-404a-9436-c611ebd19950 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:32.842675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e3d60-79c7-404a-9436-c611ebd19950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:32.843033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e3d60-79c7-404a-9436-c611ebd19950 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:32.843745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e3d60-79c7-404a-9436-c611ebd19950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:32.845905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e3d60-79c7-404a-9436-c611ebd19950 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:32.934458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d184f6-2d47-43ce-bef5-65c51360be28 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:32.950144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b32272-5cf0-4d5d-a3f9-9a84668ede94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:32.950892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32272-5cf0-4d5d-a3f9-9a84668ede94 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:32.951175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32272-5cf0-4d5d-a3f9-9a84668ede94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:32.951454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32272-5cf0-4d5d-a3f9-9a84668ede94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:32.952515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 861/1705] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:32 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:32.953553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e3d60-79c7-404a-9436-c611ebd19950 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:32.988451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b32272-5cf0-4d5d-a3f9-9a84668ede94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:32.994356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b32272-5cf0-4d5d-a3f9-9a84668ede94 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:33.031818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 845/1706] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:33.080165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e3d60-79c7-404a-9436-c611ebd19950 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:33.085428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cbdca-1453-4b93-9dcd-aa35376ce1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:33.086214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cbdca-1453-4b93-9dcd-aa35376ce1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:33.086583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cbdca-1453-4b93-9dcd-aa35376ce1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:33.086860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cbdca-1453-4b93-9dcd-aa35376ce1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:33.087638 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cbdca-1453-4b93-9dcd-aa35376ce1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:33.089591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cbdca-1453-4b93-9dcd-aa35376ce1f5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:33.142091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 862/1707] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:32 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:33.147136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b32272-5cf0-4d5d-a3f9-9a84668ede94 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:33.166166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b32272-5cf0-4d5d-a3f9-9a84668ede94 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:33.191519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725595a-bfd8-4d73-8572-6c53b902db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:33.194981 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725595a-bfd8-4d73-8572-6c53b902db28 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:33.195437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725595a-bfd8-4d73-8572-6c53b902db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:33.195983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725595a-bfd8-4d73-8572-6c53b902db28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:33.199695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725595a-bfd8-4d73-8572-6c53b902db28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:33.208624 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725595a-bfd8-4d73-8572-6c53b902db28 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:33.241497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cbdca-1453-4b93-9dcd-aa35376ce1f5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:33.252182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 846/1708] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:33.255255 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cbdca-1453-4b93-9dcd-aa35376ce1f5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:33.271910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3478f77-cf3b-4093-a824-9e3fd5267096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:33.273268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3478f77-cf3b-4093-a824-9e3fd5267096 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:33.274597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3478f77-cf3b-4093-a824-9e3fd5267096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:33.275366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3478f77-cf3b-4093-a824-9e3fd5267096 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:33.276483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3478f77-cf3b-4093-a824-9e3fd5267096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:33.279343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3478f77-cf3b-4093-a824-9e3fd5267096 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:33.307699 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725595a-bfd8-4d73-8572-6c53b902db28 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:33.308891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 863/1709] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:33.329851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725595a-bfd8-4d73-8572-6c53b902db28 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:33.341864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb432e89-b749-42a9-b98c-ffb30ae7805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:33.343428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb432e89-b749-42a9-b98c-ffb30ae7805f admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:33.344185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb432e89-b749-42a9-b98c-ffb30ae7805f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:33.344643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb432e89-b749-42a9-b98c-ffb30ae7805f admin admin] PATH_INFO: `/v3/projects/a3d8b3fe02db40778127367476f0b8c0/users/3b95bd0237174ac78108748c81571550/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:33.385918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2376a0-8162-49ed-b92f-30c80c834ccb None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:33.387523 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2376a0-8162-49ed-b92f-30c80c834ccb None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:33.388040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2376a0-8162-49ed-b92f-30c80c834ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:33.388418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb432e89-b749-42a9-b98c-ffb30ae7805f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d8b3fe02db40778127367476f0b8c0, user_id=3b95bd0237174ac78108748c81571550, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:33.397341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb432e89-b749-42a9-b98c-ffb30ae7805f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:33.430901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 847/1710] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:33 2022] PUT /identity/v3/projects/a3d8b3fe02db40778127367476f0b8c0/users/3b95bd0237174ac78108748c81571550/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:33.444709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da524-69ee-4be8-8569-3798819f231e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:33.445264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da524-69ee-4be8-8569-3798819f231e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:33.445579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da524-69ee-4be8-8569-3798819f231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:33.508399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-5a2376a0-8162-49ed-b92f-30c80c834ccb None None] MFA Rules not processed for user `e1ebd0110fff4620b11e881c90470cda`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:33.519043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5a2376a0-8162-49ed-b92f-30c80c834ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:33.548095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-007da524-69ee-4be8-8569-3798819f231e None None] MFA Rules not processed for user `3b95bd0237174ac78108748c81571550`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:33.549503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-007da524-69ee-4be8-8569-3798819f231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:33.732956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 864/1711] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:33.760112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2376a0-8162-49ed-b92f-30c80c834ccb None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:33.761827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5a2376a0-8162-49ed-b92f-30c80c834ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:33.767228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 848/1712] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:33.770656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da524-69ee-4be8-8569-3798819f231e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:34.020942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da524-69ee-4be8-8569-3798819f231e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:34.041830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037f2f-be5b-46fd-959f-898b5ae958a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:34.042539 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037f2f-be5b-46fd-959f-898b5ae958a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:34.042813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037f2f-be5b-46fd-959f-898b5ae958a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:34.043103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037f2f-be5b-46fd-959f-898b5ae958a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:34.043788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037f2f-be5b-46fd-959f-898b5ae958a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:34.056846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2376a0-8162-49ed-b92f-30c80c834ccb None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:34.057781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037f2f-be5b-46fd-959f-898b5ae958a1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:34.086994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8aae7-288c-41c4-9323-68cba8944012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:34.087680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8aae7-288c-41c4-9323-68cba8944012 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:34.087964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8aae7-288c-41c4-9323-68cba8944012 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:34.088241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8aae7-288c-41c4-9323-68cba8944012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:34.109016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8aae7-288c-41c4-9323-68cba8944012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:34.119116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8aae7-288c-41c4-9323-68cba8944012 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:34.137836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 849/1713] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:33 2022] POST /identity/v3/projects => generated 381 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:34.138646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037f2f-be5b-46fd-959f-898b5ae958a1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:34.141816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3a037f2f-be5b-46fd-959f-898b5ae958a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:34.149350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 865/1714] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:59:34.150569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8aae7-288c-41c4-9323-68cba8944012 service nova] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:34.195543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8aae7-288c-41c4-9323-68cba8944012 service nova] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:34.428345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037f2f-be5b-46fd-959f-898b5ae958a1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:34.441946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd3223-de62-4dee-8b9c-d275b2d75c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:34.442642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd3223-de62-4dee-8b9c-d275b2d75c81 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:34.445134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd3223-de62-4dee-8b9c-d275b2d75c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:34.447597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd3223-de62-4dee-8b9c-d275b2d75c81 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:34.448342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd3223-de62-4dee-8b9c-d275b2d75c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:34.450318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd3223-de62-4dee-8b9c-d275b2d75c81 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:34.452148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:34.454758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:34.464719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:34.467088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] PATH_INFO: `/v3/projects/1e3f8901b91b4fa3b751e1af2c5806ec` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:34.468931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3f8901b91b4fa3b751e1af2c5806ec)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:34.475451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:34.545273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 866/1715] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:34 2022] POST /identity/v3/users => generated 297 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:34.546265 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd3223-de62-4dee-8b9c-d275b2d75c81 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:34.614565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd3223-de62-4dee-8b9c-d275b2d75c81 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:34.641158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3f8901b91b4fa3b751e1af2c5806ec', 'request_id': 'req-d070cd37-6c68-49f1-8a46-06866dcbf0e8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:34.657496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3f8901b91b4fa3b751e1af2c5806ec', 'request_id': 'req-d070cd37-6c68-49f1-8a46-06866dcbf0e8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:34.671089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3f8901b91b4fa3b751e1af2c5806ec', 'request_id': 'req-d070cd37-6c68-49f1-8a46-06866dcbf0e8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:34.690992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] The token cache is being invalidate because project 1e3f8901b91b4fa3b751e1af2c5806ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 18:59:34.699484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:34.700491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:34.702554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 850/1716] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 18:59:34 2022] DELETE /identity/v3/projects/1e3f8901b91b4fa3b751e1af2c5806ec => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:34.706129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:34.707646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:34.831166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070cd37-6c68-49f1-8a46-06866dcbf0e8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:34.849973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:34.850178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7b8e3-779a-4e89-8637-d03675dcf1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:34.850706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7b8e3-779a-4e89-8637-d03675dcf1bc admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:34.851098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7b8e3-779a-4e89-8637-d03675dcf1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:34.851207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:34.851412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7b8e3-779a-4e89-8637-d03675dcf1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:34.851510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:34.851896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] PATH_INFO: `/v3/users/d34a56c80a6b41b592c5d4ef0e764c2a` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:34.852152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7b8e3-779a-4e89-8637-d03675dcf1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:34.854271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34a56c80a6b41b592c5d4ef0e764c2a)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:34.854407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7b8e3-779a-4e89-8637-d03675dcf1bc admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:34.856309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:34.876430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 867/1717] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:34.879844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b384faa-fae1-4752-8cad-47043d2eb50f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:34.880917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b384faa-fae1-4752-8cad-47043d2eb50f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:34.881340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b384faa-fae1-4752-8cad-47043d2eb50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:34.914043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9b384faa-fae1-4752-8cad-47043d2eb50f None None] MFA Rules not processed for user `41938583e61a45398e3e284c70204292`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:34.915743 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9b384faa-fae1-4752-8cad-47043d2eb50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:35.000856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 868/1718] 10.222.0.49 () {58 vars in 1015 bytes} [Thu May 12 18:59:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:35.002618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b384faa-fae1-4752-8cad-47043d2eb50f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:35.004433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9b384faa-fae1-4752-8cad-47043d2eb50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:35.026044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34a56c80a6b41b592c5d4ef0e764c2a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:35.034618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b384faa-fae1-4752-8cad-47043d2eb50f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:35.039961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6583-1b3c-4026-aca8-69ee54fa92a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:35.040992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6583-1b3c-4026-aca8-69ee54fa92a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:35.041357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6583-1b3c-4026-aca8-69ee54fa92a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:35.042771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6583-1b3c-4026-aca8-69ee54fa92a1 admin admin] PATH_INFO: `/v3/projects/2709f1395f884157848ca4c985eb4de0/users/b4107ac76a0647a08e46cf9fce1a1327/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:35.064549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e6583-1b3c-4026-aca8-69ee54fa92a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2709f1395f884157848ca4c985eb4de0, user_id=b4107ac76a0647a08e46cf9fce1a1327, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:35.067897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e6583-1b3c-4026-aca8-69ee54fa92a1 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:35.081578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34a56c80a6b41b592c5d4ef0e764c2a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:35.087837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 869/1719] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:35 2022] PUT /identity/v3/projects/2709f1395f884157848ca4c985eb4de0/users/b4107ac76a0647a08e46cf9fce1a1327/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:35.091825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6583-1b3c-4026-aca8-69ee54fa92a1 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:35.095949 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-871e6583-1b3c-4026-aca8-69ee54fa92a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:35.110303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34a56c80a6b41b592c5d4ef0e764c2a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:35.114691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34a56c80a6b41b592c5d4ef0e764c2a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:35.154690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34a56c80a6b41b592c5d4ef0e764c2a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:35.176482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 851/1720] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:59:34 2022] DELETE /identity/v3/users/d34a56c80a6b41b592c5d4ef0e764c2a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:59:35.183025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:35.187989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:35.232522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6583-1b3c-4026-aca8-69ee54fa92a1 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:35.339091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabda22-76ae-432d-893c-13dac797e6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:35.342836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabda22-76ae-432d-893c-13dac797e6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:35.344483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabda22-76ae-432d-893c-13dac797e6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:35.344832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabda22-76ae-432d-893c-13dac797e6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:35.351529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7cabda22-76ae-432d-893c-13dac797e6f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:35.390174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabda22-76ae-432d-893c-13dac797e6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:35.398128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabda22-76ae-432d-893c-13dac797e6f0 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:35.434515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 870/1721] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:35.460609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b666002-e5e6-42df-92cd-2004d787fffd admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:35.467897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a072b5-cb2d-4af9-90a6-d2d55153e89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:35.468854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a072b5-cb2d-4af9-90a6-d2d55153e89d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:35.469224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a072b5-cb2d-4af9-90a6-d2d55153e89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:35.469730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a072b5-cb2d-4af9-90a6-d2d55153e89d admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:35.470799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a072b5-cb2d-4af9-90a6-d2d55153e89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:35.475639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a072b5-cb2d-4af9-90a6-d2d55153e89d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:35.497544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabda22-76ae-432d-893c-13dac797e6f0 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:35.508712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 852/1722] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:35.513868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabda22-76ae-432d-893c-13dac797e6f0 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:35.530659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dd344-29a9-4bd3-8afd-bde0ac6cef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:35.542292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dd344-29a9-4bd3-8afd-bde0ac6cef4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:35.542605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dd344-29a9-4bd3-8afd-bde0ac6cef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:35.543514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dd344-29a9-4bd3-8afd-bde0ac6cef4b admin admin] PATH_INFO: `/v3/projects/2709f1395f884157848ca4c985eb4de0/users/b4107ac76a0647a08e46cf9fce1a1327/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:35.551608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dd344-29a9-4bd3-8afd-bde0ac6cef4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2709f1395f884157848ca4c985eb4de0, user_id=b4107ac76a0647a08e46cf9fce1a1327, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:35.563677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dd344-29a9-4bd3-8afd-bde0ac6cef4b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:35.618412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 871/1723] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:35 2022] PUT /identity/v3/projects/2709f1395f884157848ca4c985eb4de0/users/b4107ac76a0647a08e46cf9fce1a1327/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:35.619698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57bedf-17fe-4290-a9e2-a51b7c9019d6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:35.620229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57bedf-17fe-4290-a9e2-a51b7c9019d6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:35.620732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57bedf-17fe-4290-a9e2-a51b7c9019d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:35.715964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1c57bedf-17fe-4290-a9e2-a51b7c9019d6 None None] MFA Rules not processed for user `b4107ac76a0647a08e46cf9fce1a1327`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:35.717857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1c57bedf-17fe-4290-a9e2-a51b7c9019d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:35.919627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 853/1724] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:35.933825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dd344-29a9-4bd3-8afd-bde0ac6cef4b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:35.940093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e76dd344-29a9-4bd3-8afd-bde0ac6cef4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:36.213687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dd344-29a9-4bd3-8afd-bde0ac6cef4b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:36.226510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f739c2-3d22-47c7-ae4f-039758c561bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:36.227191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f739c2-3d22-47c7-ae4f-039758c561bb service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:36.227527 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f739c2-3d22-47c7-ae4f-039758c561bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:36.227806 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f739c2-3d22-47c7-ae4f-039758c561bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:36.256377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f739c2-3d22-47c7-ae4f-039758c561bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:36.267575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f739c2-3d22-47c7-ae4f-039758c561bb service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:36.314167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 872/1725] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:36.529213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57bedf-17fe-4290-a9e2-a51b7c9019d6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:36.542214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57bedf-17fe-4290-a9e2-a51b7c9019d6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:36.567070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381dedf-d0b3-4c05-bab5-81494ccdc85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:36.569980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381dedf-d0b3-4c05-bab5-81494ccdc85c service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:36.570520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381dedf-d0b3-4c05-bab5-81494ccdc85c service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:36.571037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381dedf-d0b3-4c05-bab5-81494ccdc85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:36.579632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d381dedf-d0b3-4c05-bab5-81494ccdc85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:36.840150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381dedf-d0b3-4c05-bab5-81494ccdc85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:36.841649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381dedf-d0b3-4c05-bab5-81494ccdc85c service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:36.878478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 854/1726] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:37.420979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3b6e-a48f-483b-b907-d780e325c588 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:37.421582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3b6e-a48f-483b-b907-d780e325c588 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:37.422935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3b6e-a48f-483b-b907-d780e325c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:37.579872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-276e3b6e-a48f-483b-b907-d780e325c588 None None] MFA Rules not processed for user `1df4257419c4434fa22edb0805c1a204`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:37.586655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-276e3b6e-a48f-483b-b907-d780e325c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:37.791203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 873/1727] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:37.803182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee367b8-52e2-4619-99cf-594ee7b9c52d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:37.804078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee367b8-52e2-4619-99cf-594ee7b9c52d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:37.804502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee367b8-52e2-4619-99cf-594ee7b9c52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:37.846783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-cee367b8-52e2-4619-99cf-594ee7b9c52d None None] MFA Rules not processed for user `1df4257419c4434fa22edb0805c1a204`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:37.850352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cee367b8-52e2-4619-99cf-594ee7b9c52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:37.865870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 855/1728] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:37.883556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3b6e-a48f-483b-b907-d780e325c588 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:37.894611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-276e3b6e-a48f-483b-b907-d780e325c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:38.157359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3b6e-a48f-483b-b907-d780e325c588 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:38.169185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782e431-9a52-42ed-80bb-e5c3c413c22a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:38.170159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782e431-9a52-42ed-80bb-e5c3c413c22a service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:38.170604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782e431-9a52-42ed-80bb-e5c3c413c22a service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:38.171040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782e431-9a52-42ed-80bb-e5c3c413c22a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:38.189760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782e431-9a52-42ed-80bb-e5c3c413c22a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:38.191546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782e431-9a52-42ed-80bb-e5c3c413c22a service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:38.225656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 874/1729] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:39.625811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee367b8-52e2-4619-99cf-594ee7b9c52d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:39.629056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cee367b8-52e2-4619-99cf-594ee7b9c52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:39.892134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee367b8-52e2-4619-99cf-594ee7b9c52d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:39.905903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:39.906802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:39.907078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:39.907363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] PATH_INFO: `/v3/projects/ff1fd96d2fab4215abd8bfd8b97d64d3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:39.914852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1fd96d2fab4215abd8bfd8b97d64d3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:39.924614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:40.162365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1fd96d2fab4215abd8bfd8b97d64d3', 'request_id': 'req-54a05b36-bbfd-4b55-a308-139f137801ad'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:40.200736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1fd96d2fab4215abd8bfd8b97d64d3', 'request_id': 'req-54a05b36-bbfd-4b55-a308-139f137801ad'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:40.236133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1fd96d2fab4215abd8bfd8b97d64d3', 'request_id': 'req-54a05b36-bbfd-4b55-a308-139f137801ad'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:40.319577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] The token cache is being invalidate because project ff1fd96d2fab4215abd8bfd8b97d64d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 18:59:40.319869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:40.321490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-54a05b36-bbfd-4b55-a308-139f137801ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:40.328822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79e11-7386-498a-b51b-8d020f92be21 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:40.329443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79e11-7386-498a-b51b-8d020f92be21 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:40.329443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79e11-7386-498a-b51b-8d020f92be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:40.329736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 856/1730] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 18:59:39 2022] DELETE /identity/v3/projects/ff1fd96d2fab4215abd8bfd8b97d64d3 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:40.373832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c6b79e11-7386-498a-b51b-8d020f92be21 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:40.375400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c6b79e11-7386-498a-b51b-8d020f92be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:40.539869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 875/1731] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:40.542866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfdd09-4095-4876-8abd-83493f237bdb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:40.543330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfdd09-4095-4876-8abd-83493f237bdb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:40.543757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfdd09-4095-4876-8abd-83493f237bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:40.607561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-abdfdd09-4095-4876-8abd-83493f237bdb None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:40.608934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-abdfdd09-4095-4876-8abd-83493f237bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:40.627133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b79e11-7386-498a-b51b-8d020f92be21 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:40.629257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 857/1732] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:40.644798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b79e11-7386-498a-b51b-8d020f92be21 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:40.708873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5ff54-dd08-43f2-9bc3-45d9b68b927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:40.709876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ff54-dd08-43f2-9bc3-45d9b68b927d admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:40.710186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ff54-dd08-43f2-9bc3-45d9b68b927d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:40.710443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ff54-dd08-43f2-9bc3-45d9b68b927d admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:40.711183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5ff54-dd08-43f2-9bc3-45d9b68b927d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:40.712071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5ff54-dd08-43f2-9bc3-45d9b68b927d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:40.719014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5ff54-dd08-43f2-9bc3-45d9b68b927d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:40.750474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 876/1733] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 18:59:40.751707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfdd09-4095-4876-8abd-83493f237bdb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:40.776255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfdd09-4095-4876-8abd-83493f237bdb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:40.785260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c841e-b281-418c-bc1a-54ad2b349def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:40.786237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c841e-b281-418c-bc1a-54ad2b349def admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:40.787215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c841e-b281-418c-bc1a-54ad2b349def admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:40.788600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c841e-b281-418c-bc1a-54ad2b349def admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:40.792335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c841e-b281-418c-bc1a-54ad2b349def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:40.794856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c841e-b281-418c-bc1a-54ad2b349def admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:40.885154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 858/1734] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:40 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:40.886490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5ff54-dd08-43f2-9bc3-45d9b68b927d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:40.922639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5ff54-dd08-43f2-9bc3-45d9b68b927d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:41.234914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e8299-6a26-40f9-be3e-f7c6d657d29d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:41.235253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e8299-6a26-40f9-be3e-f7c6d657d29d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:41.235535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e8299-6a26-40f9-be3e-f7c6d657d29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:41.275677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fb267-9a42-4632-bd0e-e2d35c50c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:41.279056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb267-9a42-4632-bd0e-e2d35c50c3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:41.288987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb267-9a42-4632-bd0e-e2d35c50c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:41.290109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb267-9a42-4632-bd0e-e2d35c50c3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:41.291194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fb267-9a42-4632-bd0e-e2d35c50c3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:41.298322 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-994e8299-6a26-40f9-be3e-f7c6d657d29d None None] MFA Rules not processed for user `2c202a7f2c484cd3b0363b75c1a673a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:41.306907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fb267-9a42-4632-bd0e-e2d35c50c3b4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:41.331350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-994e8299-6a26-40f9-be3e-f7c6d657d29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:41.389749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 877/1735] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:40 2022] POST /identity/v3/users => generated 293 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:41.392046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72b8d-08b6-4b1f-9383-63945c9bab2e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:41.395338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72b8d-08b6-4b1f-9383-63945c9bab2e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:41.396839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72b8d-08b6-4b1f-9383-63945c9bab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:41.502981 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 859/1736] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:41.508465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e8299-6a26-40f9-be3e-f7c6d657d29d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:41.532702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e8299-6a26-40f9-be3e-f7c6d657d29d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:41.540899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e1d72b8d-08b6-4b1f-9383-63945c9bab2e None None] MFA Rules not processed for user `1df4257419c4434fa22edb0805c1a204`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:41.544531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a74da-7216-4374-bbca-eb8ea71b0154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:41.546397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a74da-7216-4374-bbca-eb8ea71b0154 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:41.547104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e1d72b8d-08b6-4b1f-9383-63945c9bab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:41.556509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a74da-7216-4374-bbca-eb8ea71b0154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:41.562133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a74da-7216-4374-bbca-eb8ea71b0154 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:41.566479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a74da-7216-4374-bbca-eb8ea71b0154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:41.574768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a74da-7216-4374-bbca-eb8ea71b0154 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:41.619353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 860/1737] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:41.622421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a74da-7216-4374-bbca-eb8ea71b0154 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:41.669583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a74da-7216-4374-bbca-eb8ea71b0154 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:41.695542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e853b-a7ea-4f47-9ec3-c85cd2b9f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:41.698222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e853b-a7ea-4f47-9ec3-c85cd2b9f5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:41.699846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e853b-a7ea-4f47-9ec3-c85cd2b9f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:41.700351 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e853b-a7ea-4f47-9ec3-c85cd2b9f5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:41.704535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e853b-a7ea-4f47-9ec3-c85cd2b9f5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:41.706549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e853b-a7ea-4f47-9ec3-c85cd2b9f5d4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:41.742005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 861/1738] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:41.746056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e853b-a7ea-4f47-9ec3-c85cd2b9f5d4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:41.769281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e853b-a7ea-4f47-9ec3-c85cd2b9f5d4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:41.785852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd201-7d00-4120-8791-01641988cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:41.787310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd201-7d00-4120-8791-01641988cc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:41.787765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd201-7d00-4120-8791-01641988cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:41.788286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd201-7d00-4120-8791-01641988cc5d admin admin] PATH_INFO: `/v3/projects/86a723cc621d4d3b9822bfca79fe2f71/users/7aad8a7e00b6443992dfa490a107a95a/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:41.822619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 878/1739] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:41.840411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd201-7d00-4120-8791-01641988cc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a723cc621d4d3b9822bfca79fe2f71, user_id=7aad8a7e00b6443992dfa490a107a95a, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:41.859324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd201-7d00-4120-8791-01641988cc5d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:41.889552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 862/1740] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:41 2022] PUT /identity/v3/projects/86a723cc621d4d3b9822bfca79fe2f71/users/7aad8a7e00b6443992dfa490a107a95a/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:41.900595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa2cca-8f08-4bff-8249-8638fd8f4102 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:41.901321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa2cca-8f08-4bff-8249-8638fd8f4102 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:41.901797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa2cca-8f08-4bff-8249-8638fd8f4102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:41.963577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-03aa2cca-8f08-4bff-8249-8638fd8f4102 None None] MFA Rules not processed for user `7aad8a7e00b6443992dfa490a107a95a`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:41.964952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-03aa2cca-8f08-4bff-8249-8638fd8f4102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:42.112009 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46072a9e-9976-4bbe-9eec-5863c619904b None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:42.112306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46072a9e-9976-4bbe-9eec-5863c619904b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:42.112757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46072a9e-9976-4bbe-9eec-5863c619904b None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:42.114535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 863/1741] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 18:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:59:42.168936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dc62b-d4ec-425c-b4d8-3c0d4d8a5cb3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:42.169135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dc62b-d4ec-425c-b4d8-3c0d4d8a5cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:42.169631 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dc62b-d4ec-425c-b4d8-3c0d4d8a5cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:42.182963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 879/1742] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:42.187121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa2cca-8f08-4bff-8249-8638fd8f4102 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:42.215555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e98dc62b-d4ec-425c-b4d8-3c0d4d8a5cb3 None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:42.217152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e98dc62b-d4ec-425c-b4d8-3c0d4d8a5cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:42.364095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa2cca-8f08-4bff-8249-8638fd8f4102 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:42.389422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b18314-b6f0-43a1-8b06-4c77faeb00ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:42.390467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b18314-b6f0-43a1-8b06-4c77faeb00ef admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:42.391363 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b18314-b6f0-43a1-8b06-4c77faeb00ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:42.391778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b18314-b6f0-43a1-8b06-4c77faeb00ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:42.392625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b18314-b6f0-43a1-8b06-4c77faeb00ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:42.395364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b18314-b6f0-43a1-8b06-4c77faeb00ef admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:42.463102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 880/1743] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:42 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:59:42.464876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b18314-b6f0-43a1-8b06-4c77faeb00ef admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:42.465616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 864/1744] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:42.594629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b18314-b6f0-43a1-8b06-4c77faeb00ef admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:42.601698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b18ab-9593-4c5a-8922-e0b33535061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:42.602388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b18ab-9593-4c5a-8922-e0b33535061e admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:42.602672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b18ab-9593-4c5a-8922-e0b33535061e admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:42.602987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b18ab-9593-4c5a-8922-e0b33535061e admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:42.603738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b18ab-9593-4c5a-8922-e0b33535061e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:42.605835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b18ab-9593-4c5a-8922-e0b33535061e admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:42.653053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dc62b-d4ec-425c-b4d8-3c0d4d8a5cb3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:42.654065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 881/1745] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:42 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:42.690184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dc62b-d4ec-425c-b4d8-3c0d4d8a5cb3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:42.708983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acd899-3297-4254-ac82-b81b1803fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:42.709713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd899-3297-4254-ac82-b81b1803fa1a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:42.710003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd899-3297-4254-ac82-b81b1803fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:42.710436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd899-3297-4254-ac82-b81b1803fa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:42.711181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acd899-3297-4254-ac82-b81b1803fa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:42.713093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acd899-3297-4254-ac82-b81b1803fa1a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:42.760896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 865/1746] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 18:59:42.762580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b18ab-9593-4c5a-8922-e0b33535061e admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:42.806660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b18ab-9593-4c5a-8922-e0b33535061e admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:42.821799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fe41f-c74b-422d-a553-f93a2decbd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:42.822497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fe41f-c74b-422d-a553-f93a2decbd5b admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:42.822784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fe41f-c74b-422d-a553-f93a2decbd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:42.823061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fe41f-c74b-422d-a553-f93a2decbd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:42.823800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fe41f-c74b-422d-a553-f93a2decbd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:42.825443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fe41f-c74b-422d-a553-f93a2decbd5b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:42.860700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 882/1747] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:42.862541 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acd899-3297-4254-ac82-b81b1803fa1a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:42.876016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acd899-3297-4254-ac82-b81b1803fa1a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:42.884334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67886b0-f742-46b9-927a-91e661f60331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:42.886102 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67886b0-f742-46b9-927a-91e661f60331 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:42.886534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67886b0-f742-46b9-927a-91e661f60331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:42.886952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67886b0-f742-46b9-927a-91e661f60331 admin admin] PATH_INFO: `/v3/projects/3ad9262b52844e08aba4e3290b14a300/users/44aa621571264a809982bc156ed80ab2/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:42.907475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67886b0-f742-46b9-927a-91e661f60331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad9262b52844e08aba4e3290b14a300, user_id=44aa621571264a809982bc156ed80ab2, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:42.910943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67886b0-f742-46b9-927a-91e661f60331 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:42.945745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 866/1748] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:42 2022] PUT /identity/v3/projects/3ad9262b52844e08aba4e3290b14a300/users/44aa621571264a809982bc156ed80ab2/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:42.946571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed717762-f7f7-43cf-9ef8-29700fd68df1 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:42.946970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed717762-f7f7-43cf-9ef8-29700fd68df1 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:42.947355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed717762-f7f7-43cf-9ef8-29700fd68df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:43.022473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-ed717762-f7f7-43cf-9ef8-29700fd68df1 None None] MFA Rules not processed for user `44aa621571264a809982bc156ed80ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:43.023725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ed717762-f7f7-43cf-9ef8-29700fd68df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:43.179197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 883/1749] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:43.183576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67886b0-f742-46b9-927a-91e661f60331 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:43.212521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900d94-7e44-44ac-8aeb-a5e684c39ec7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:43.212949 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900d94-7e44-44ac-8aeb-a5e684c39ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:43.213360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900d94-7e44-44ac-8aeb-a5e684c39ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:43.276033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-61900d94-7e44-44ac-8aeb-a5e684c39ec7 None None] MFA Rules not processed for user `803b29a8c5e34ef0993913c0b08ccfd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:43.277235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-61900d94-7e44-44ac-8aeb-a5e684c39ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:43.326937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67886b0-f742-46b9-927a-91e661f60331 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:43.339944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af021879-4187-415c-aad7-907acf81f522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:43.340902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af021879-4187-415c-aad7-907acf81f522 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:43.341345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af021879-4187-415c-aad7-907acf81f522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:43.341798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af021879-4187-415c-aad7-907acf81f522 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:43.342652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af021879-4187-415c-aad7-907acf81f522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:43.353250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af021879-4187-415c-aad7-907acf81f522 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:43.400581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 884/1750] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:43.403493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c651-0788-4278-8bdd-90ecad8de14c None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:43.403841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c651-0788-4278-8bdd-90ecad8de14c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:43.404222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c651-0788-4278-8bdd-90ecad8de14c None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:43.405935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 885/1751] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 12 18:59:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 18:59:43.409894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 867/1752] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:43 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:43.422801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af021879-4187-415c-aad7-907acf81f522 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:43.425799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64afc0-a1e6-4c08-bd43-af799d7ebe42 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:43.426201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64afc0-a1e6-4c08-bd43-af799d7ebe42 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:43.426585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64afc0-a1e6-4c08-bd43-af799d7ebe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:43.499949 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9f64afc0-a1e6-4c08-bd43-af799d7ebe42 None None] MFA Rules not processed for user `41938583e61a45398e3e284c70204292`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:43.501568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9f64afc0-a1e6-4c08-bd43-af799d7ebe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:43.581300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af021879-4187-415c-aad7-907acf81f522 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:43.599346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85ffee-5f7c-436d-81af-e00758af78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:43.602868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85ffee-5f7c-436d-81af-e00758af78e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:43.603443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85ffee-5f7c-436d-81af-e00758af78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:43.603929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85ffee-5f7c-436d-81af-e00758af78e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:43.604853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85ffee-5f7c-436d-81af-e00758af78e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:43.608411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85ffee-5f7c-436d-81af-e00758af78e2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:43.633335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 868/1753] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:43 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:43.637191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85ffee-5f7c-436d-81af-e00758af78e2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:43.640093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 886/1754] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 18:59:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:43.664132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85ffee-5f7c-436d-81af-e00758af78e2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:43.670200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6809f-e733-478d-a472-4f10b45554d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:43.670893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6809f-e733-478d-a472-4f10b45554d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:43.671204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6809f-e733-478d-a472-4f10b45554d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:43.671500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6809f-e733-478d-a472-4f10b45554d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:43.672256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6809f-e733-478d-a472-4f10b45554d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:43.674151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6809f-e733-478d-a472-4f10b45554d1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:43.694595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 869/1755] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:43.698783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64afc0-a1e6-4c08-bd43-af799d7ebe42 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:43.714747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6809f-e733-478d-a472-4f10b45554d1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:43.719207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a6a6809f-e733-478d-a472-4f10b45554d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:43.727669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64afc0-a1e6-4c08-bd43-af799d7ebe42 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:43.754286 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c42bc-1b27-40a1-b3de-394b3155adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:43.763867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c42bc-1b27-40a1-b3de-394b3155adbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:43.763867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c42bc-1b27-40a1-b3de-394b3155adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:43.763867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c42bc-1b27-40a1-b3de-394b3155adbf admin admin] PATH_INFO: `/v3/projects/f8435aeed04c4d9e8ca315a79725b8ad/users/ed57afe589f44eddab5e6d407f26f033/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:43.765157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6809f-e733-478d-a472-4f10b45554d1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:43.787298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792b576-c5de-410f-ada3-46368920c500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:43.787995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792b576-c5de-410f-ada3-46368920c500 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:43.788283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792b576-c5de-410f-ada3-46368920c500 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:43.788537 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792b576-c5de-410f-ada3-46368920c500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:43.800276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792b576-c5de-410f-ada3-46368920c500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:43.810611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792b576-c5de-410f-ada3-46368920c500 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:43.811850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c42bc-1b27-40a1-b3de-394b3155adbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8435aeed04c4d9e8ca315a79725b8ad, user_id=ed57afe589f44eddab5e6d407f26f033, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:43.814589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c42bc-1b27-40a1-b3de-394b3155adbf admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:43.835752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 870/1756] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:43.846924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 887/1757] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:43 2022] PUT /identity/v3/projects/f8435aeed04c4d9e8ca315a79725b8ad/users/ed57afe589f44eddab5e6d407f26f033/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:59:43.850890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792b576-c5de-410f-ada3-46368920c500 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:43.872572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792b576-c5de-410f-ada3-46368920c500 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:44.013471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69555ddb-02f8-4ad2-9fbe-0ed9034124d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:44.014571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69555ddb-02f8-4ad2-9fbe-0ed9034124d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:44.015026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69555ddb-02f8-4ad2-9fbe-0ed9034124d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:44.015445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69555ddb-02f8-4ad2-9fbe-0ed9034124d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:44.016653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69555ddb-02f8-4ad2-9fbe-0ed9034124d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:44.019414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69555ddb-02f8-4ad2-9fbe-0ed9034124d9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:44.048312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 871/1758] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:44.053403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c42bc-1b27-40a1-b3de-394b3155adbf admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:44.079576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c42bc-1b27-40a1-b3de-394b3155adbf admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:44.101841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576e4e7-edd9-4b63-9f69-5e473f81cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:44.102833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e4e7-edd9-4b63-9f69-5e473f81cfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:44.103127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e4e7-edd9-4b63-9f69-5e473f81cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:44.103385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e4e7-edd9-4b63-9f69-5e473f81cfd7 admin admin] PATH_INFO: `/v3/projects/f8435aeed04c4d9e8ca315a79725b8ad/users/ed57afe589f44eddab5e6d407f26f033/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:44.113336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576e4e7-edd9-4b63-9f69-5e473f81cfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8435aeed04c4d9e8ca315a79725b8ad, user_id=ed57afe589f44eddab5e6d407f26f033, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:44.121616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576e4e7-edd9-4b63-9f69-5e473f81cfd7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:44.172742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 888/1759] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:44 2022] PUT /identity/v3/projects/f8435aeed04c4d9e8ca315a79725b8ad/users/ed57afe589f44eddab5e6d407f26f033/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:44.182393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856022-fa30-4ea1-8555-6ccf58be9823 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:44.183069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856022-fa30-4ea1-8555-6ccf58be9823 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:44.183921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856022-fa30-4ea1-8555-6ccf58be9823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:44.315614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-40856022-fa30-4ea1-8555-6ccf58be9823 None None] MFA Rules not processed for user `ed57afe589f44eddab5e6d407f26f033`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:44.319595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-40856022-fa30-4ea1-8555-6ccf58be9823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:44.521683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 872/1760] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:44.534994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576e4e7-edd9-4b63-9f69-5e473f81cfd7 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:44.538793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4576e4e7-edd9-4b63-9f69-5e473f81cfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:44.686699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576e4e7-edd9-4b63-9f69-5e473f81cfd7 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:44.694261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748b075-0d27-446c-96d4-3ff8aaf1308b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:44.695262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748b075-0d27-446c-96d4-3ff8aaf1308b service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:44.695750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748b075-0d27-446c-96d4-3ff8aaf1308b service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:44.697126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748b075-0d27-446c-96d4-3ff8aaf1308b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:44.714560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748b075-0d27-446c-96d4-3ff8aaf1308b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:44.727195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748b075-0d27-446c-96d4-3ff8aaf1308b service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:44.765907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 889/1761] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:44.899809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40856022-fa30-4ea1-8555-6ccf58be9823 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:44.901945 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-40856022-fa30-4ea1-8555-6ccf58be9823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:45.289544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bebb7-285f-4019-8905-489657d27e99 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:45.289790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bebb7-285f-4019-8905-489657d27e99 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:45.289917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bebb7-285f-4019-8905-489657d27e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:45.362107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-150bebb7-285f-4019-8905-489657d27e99 None None] MFA Rules not processed for user `e1ebd0110fff4620b11e881c90470cda`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:45.366030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40856022-fa30-4ea1-8555-6ccf58be9823 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:45.373405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-150bebb7-285f-4019-8905-489657d27e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:45.425708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57b191-3fef-41a4-a745-fd0e4db5c146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:45.426390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57b191-3fef-41a4-a745-fd0e4db5c146 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:45.426671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57b191-3fef-41a4-a745-fd0e4db5c146 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:45.428528 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57b191-3fef-41a4-a745-fd0e4db5c146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:45.537834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57b191-3fef-41a4-a745-fd0e4db5c146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:45.539458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57b191-3fef-41a4-a745-fd0e4db5c146 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:45.606014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 890/1762] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:45.624738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 873/1763] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:45.929577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bebb7-285f-4019-8905-489657d27e99 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:45.949226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bebb7-285f-4019-8905-489657d27e99 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:45.963057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307227f0-5b32-4f69-b624-52572a9539a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:45.963730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307227f0-5b32-4f69-b624-52572a9539a5 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:45.964013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307227f0-5b32-4f69-b624-52572a9539a5 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:45.964287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307227f0-5b32-4f69-b624-52572a9539a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:46.229792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307227f0-5b32-4f69-b624-52572a9539a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:46.231615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307227f0-5b32-4f69-b624-52572a9539a5 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:46.251472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 891/1764] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:46.602985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57b191-3fef-41a4-a745-fd0e4db5c146 service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:46.604641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4e57b191-3fef-41a4-a745-fd0e4db5c146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:46.650621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57b191-3fef-41a4-a745-fd0e4db5c146 service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:46.672392 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b773-88f4-4a38-ace2-a323636f0ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:46.673076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b773-88f4-4a38-ace2-a323636f0ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:46.673365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b773-88f4-4a38-ace2-a323636f0ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:46.673673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b773-88f4-4a38-ace2-a323636f0ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:46.847382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b773-88f4-4a38-ace2-a323636f0ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:46.861976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b773-88f4-4a38-ace2-a323636f0ec3 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:46.881763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 874/1765] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:48.710083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c78204-0aad-4383-8d61-13e5b105cc6f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:48.711089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c78204-0aad-4383-8d61-13e5b105cc6f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:48.712858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c78204-0aad-4383-8d61-13e5b105cc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:48.743945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-37c78204-0aad-4383-8d61-13e5b105cc6f None None] MFA Rules not processed for user `803b29a8c5e34ef0993913c0b08ccfd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:48.746081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-37c78204-0aad-4383-8d61-13e5b105cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:48.756490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 892/1766] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:52.685176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b773-88f4-4a38-ace2-a323636f0ec3 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:52.687297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9939b773-88f4-4a38-ace2-a323636f0ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:52.764197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b773-88f4-4a38-ace2-a323636f0ec3 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:52.769414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:52.770389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:52.770676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:52.770952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] PATH_INFO: `/v3/users/3b95bd0237174ac78108748c81571550` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:52.772154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b95bd0237174ac78108748c81571550)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:52.774119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:52.831875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b95bd0237174ac78108748c81571550'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:52.844865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b95bd0237174ac78108748c81571550'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:52.852282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b95bd0237174ac78108748c81571550'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:52.853074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b95bd0237174ac78108748c81571550'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:52.861138 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b95bd0237174ac78108748c81571550'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:52.868626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 875/1767] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:59:52 2022] DELETE /identity/v3/users/3b95bd0237174ac78108748c81571550 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:52.873094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70154bd-4db3-42a2-9ddb-ef11b3fdcc7a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:52.874020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70154bd-4db3-42a2-9ddb-ef11b3fdcc7a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:52.874377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70154bd-4db3-42a2-9ddb-ef11b3fdcc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:52.894214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d70154bd-4db3-42a2-9ddb-ef11b3fdcc7a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:52.895947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d70154bd-4db3-42a2-9ddb-ef11b3fdcc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:52.971792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 893/1768] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:52.982494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:52.984000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:53.046400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1d3a5-1242-4d57-b20d-e660d969d992 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:53.050018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03d791-d38a-4ce6-a8f9-5cf64113631b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:53.050657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03d791-d38a-4ce6-a8f9-5cf64113631b service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:53.050938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03d791-d38a-4ce6-a8f9-5cf64113631b service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:53.051213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03d791-d38a-4ce6-a8f9-5cf64113631b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:53.060076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03d791-d38a-4ce6-a8f9-5cf64113631b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:53.061433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03d791-d38a-4ce6-a8f9-5cf64113631b service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:53.070733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 876/1769] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:59:53.368983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70154bd-4db3-42a2-9ddb-ef11b3fdcc7a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:53.370447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d70154bd-4db3-42a2-9ddb-ef11b3fdcc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:53.382939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70154bd-4db3-42a2-9ddb-ef11b3fdcc7a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:53.387603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:53.388470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:53.388907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:53.389187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] PATH_INFO: `/v3/projects/a3d8b3fe02db40778127367476f0b8c0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:53.390599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d8b3fe02db40778127367476f0b8c0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:53.392524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:53.440273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d8b3fe02db40778127367476f0b8c0', 'request_id': 'req-e937ea37-96d7-4859-b15b-7ac68506c759'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.447710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d8b3fe02db40778127367476f0b8c0', 'request_id': 'req-e937ea37-96d7-4859-b15b-7ac68506c759'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.454567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d8b3fe02db40778127367476f0b8c0', 'request_id': 'req-e937ea37-96d7-4859-b15b-7ac68506c759'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.466869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] The token cache is being invalidate because project a3d8b3fe02db40778127367476f0b8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 18:59:53.467162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.467809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.469404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 894/1770] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 18:59:53 2022] DELETE /identity/v3/projects/a3d8b3fe02db40778127367476f0b8c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:53.473413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03d791-d38a-4ce6-a8f9-5cf64113631b service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:53.485921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03d791-d38a-4ce6-a8f9-5cf64113631b service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:53.631890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:53.632870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:53.633243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:53.633422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] PATH_INFO: `/v3/users/b4107ac76a0647a08e46cf9fce1a1327` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:53.637314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4107ac76a0647a08e46cf9fce1a1327)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:53.639857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:53.736393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4107ac76a0647a08e46cf9fce1a1327'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.752710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4107ac76a0647a08e46cf9fce1a1327'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.762875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4107ac76a0647a08e46cf9fce1a1327'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.764162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4107ac76a0647a08e46cf9fce1a1327'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.774697 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70e28a5f-47a1-4b56-ad27-6bf57778f809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4107ac76a0647a08e46cf9fce1a1327'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:53.784693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 877/1771] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:59:53 2022] DELETE /identity/v3/users/b4107ac76a0647a08e46cf9fce1a1327 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 18:59:54.670597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:54.672059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:54.696419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937ea37-96d7-4859-b15b-7ac68506c759 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:54.834704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:54.836056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:54.836350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:54.836622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] PATH_INFO: `/v3/projects/2709f1395f884157848ca4c985eb4de0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:54.838067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2709f1395f884157848ca4c985eb4de0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:54.840205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:54.925138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2709f1395f884157848ca4c985eb4de0', 'request_id': 'req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:54.934544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2709f1395f884157848ca4c985eb4de0', 'request_id': 'req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:54.941890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2709f1395f884157848ca4c985eb4de0', 'request_id': 'req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:54.978920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] The token cache is being invalidate because project 2709f1395f884157848ca4c985eb4de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 18:59:54.981139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:54.984411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b1ed012b-d72c-4c0d-9d28-bac2e129f1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:54.996164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 895/1772] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 18:59:54 2022] DELETE /identity/v3/projects/2709f1395f884157848ca4c985eb4de0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:55.000992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4e0c-47df-4fde-a3fe-d5101a6949e1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:55.001975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4e0c-47df-4fde-a3fe-d5101a6949e1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:55.002419 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4e0c-47df-4fde-a3fe-d5101a6949e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:55.055592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a14b4e0c-47df-4fde-a3fe-d5101a6949e1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:55.058136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a14b4e0c-47df-4fde-a3fe-d5101a6949e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:55.181077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 878/1773] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:55.189630 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564842fd-3d07-41f7-83a7-76c41191ac0d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:55.190133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564842fd-3d07-41f7-83a7-76c41191ac0d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:55.190574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564842fd-3d07-41f7-83a7-76c41191ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:55.218580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-564842fd-3d07-41f7-83a7-76c41191ac0d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:55.219963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-564842fd-3d07-41f7-83a7-76c41191ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:55.242442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 896/1774] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:55.247167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4e0c-47df-4fde-a3fe-d5101a6949e1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:55.258128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4e0c-47df-4fde-a3fe-d5101a6949e1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:55.267166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038629-677b-4cdd-98f8-9bb159b1818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:55.268054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038629-677b-4cdd-98f8-9bb159b1818f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:55.268514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038629-677b-4cdd-98f8-9bb159b1818f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:55.269611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038629-677b-4cdd-98f8-9bb159b1818f admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:55.272028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04038629-677b-4cdd-98f8-9bb159b1818f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 18:59:55.272502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04038629-677b-4cdd-98f8-9bb159b1818f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:55.275213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04038629-677b-4cdd-98f8-9bb159b1818f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:55.298559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 879/1775] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 18:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 18:59:55.299940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564842fd-3d07-41f7-83a7-76c41191ac0d None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:55.313304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564842fd-3d07-41f7-83a7-76c41191ac0d None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:55.323845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822cdc-2224-4973-96ce-07622baa54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:55.326090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822cdc-2224-4973-96ce-07622baa54f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:55.326486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822cdc-2224-4973-96ce-07622baa54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:55.326996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822cdc-2224-4973-96ce-07622baa54f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:55.327913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822cdc-2224-4973-96ce-07622baa54f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:55.332051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822cdc-2224-4973-96ce-07622baa54f3 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:55.389799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038629-677b-4cdd-98f8-9bb159b1818f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:55.390165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 897/1776] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:55 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:55.411719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038629-677b-4cdd-98f8-9bb159b1818f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:55.538593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf02f46-990c-4196-8d55-31e705b9517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:55.541505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf02f46-990c-4196-8d55-31e705b9517c admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:55.542040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf02f46-990c-4196-8d55-31e705b9517c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:55.542476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf02f46-990c-4196-8d55-31e705b9517c admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:55.544995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf02f46-990c-4196-8d55-31e705b9517c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:55.547557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf02f46-990c-4196-8d55-31e705b9517c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:55.602090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 880/1777] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:55 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:55.606419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822cdc-2224-4973-96ce-07622baa54f3 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:55.623038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822cdc-2224-4973-96ce-07622baa54f3 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:55.636168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b49e-084c-4303-a05e-e922284cc540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:55.639760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b49e-084c-4303-a05e-e922284cc540 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:55.640073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b49e-084c-4303-a05e-e922284cc540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:55.640358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b49e-084c-4303-a05e-e922284cc540 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:55.641129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1b49e-084c-4303-a05e-e922284cc540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:55.645923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1b49e-084c-4303-a05e-e922284cc540 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:55.672915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 898/1778] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:55.677165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf02f46-990c-4196-8d55-31e705b9517c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:55.687478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf02f46-990c-4196-8d55-31e705b9517c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:55.693996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc081b0-d5b4-4465-8fb6-61d1770a7171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:55.694736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc081b0-d5b4-4465-8fb6-61d1770a7171 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:55.695035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc081b0-d5b4-4465-8fb6-61d1770a7171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:55.695368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc081b0-d5b4-4465-8fb6-61d1770a7171 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:55.696343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc081b0-d5b4-4465-8fb6-61d1770a7171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:55.699722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc081b0-d5b4-4465-8fb6-61d1770a7171 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:55.726890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b49e-084c-4303-a05e-e922284cc540 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:55.739363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 881/1779] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:55.741488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b49e-084c-4303-a05e-e922284cc540 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:55.756549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d5ca-cb76-4d1c-b696-289341161305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:55.756549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d5ca-cb76-4d1c-b696-289341161305 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:55.756549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d5ca-cb76-4d1c-b696-289341161305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:55.756549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d5ca-cb76-4d1c-b696-289341161305 admin admin] PATH_INFO: `/v3/projects/0b3adb30338948b580fdcf5e95dc205c/users/8206aa3f9fee4dec848b4a2e8901af0e/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:55.771150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63d5ca-cb76-4d1c-b696-289341161305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3adb30338948b580fdcf5e95dc205c, user_id=8206aa3f9fee4dec848b4a2e8901af0e, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:55.775625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63d5ca-cb76-4d1c-b696-289341161305 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:55.801908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 899/1780] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:55 2022] PUT /identity/v3/projects/0b3adb30338948b580fdcf5e95dc205c/users/8206aa3f9fee4dec848b4a2e8901af0e/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:55.822211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed84be-144b-4381-9062-69198c808be9 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:55.822680 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed84be-144b-4381-9062-69198c808be9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:55.823052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed84be-144b-4381-9062-69198c808be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:55.886377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-54ed84be-144b-4381-9062-69198c808be9 None None] MFA Rules not processed for user `8206aa3f9fee4dec848b4a2e8901af0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:55.887750 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-54ed84be-144b-4381-9062-69198c808be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:55.994810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d5ca-cb76-4d1c-b696-289341161305 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:55.996718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ca63d5ca-cb76-4d1c-b696-289341161305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:56.019139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 882/1781] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:56.023572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed84be-144b-4381-9062-69198c808be9 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:56.095680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d5ca-cb76-4d1c-b696-289341161305 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:56.100654 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1d592-55dc-41e4-93f6-ec8d9765885a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:56.101754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1d592-55dc-41e4-93f6-ec8d9765885a service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:56.102184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1d592-55dc-41e4-93f6-ec8d9765885a service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:56.102749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1d592-55dc-41e4-93f6-ec8d9765885a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:56.105035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-feb1d592-55dc-41e4-93f6-ec8d9765885a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:56.117802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed84be-144b-4381-9062-69198c808be9 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:56.123214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4da2-a956-4405-aa1c-66b97122c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:56.124495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4da2-a956-4405-aa1c-66b97122c76d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:56.124935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4da2-a956-4405-aa1c-66b97122c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:56.125468 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4da2-a956-4405-aa1c-66b97122c76d admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:56.126392 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa4da2-a956-4405-aa1c-66b97122c76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:56.129068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa4da2-a956-4405-aa1c-66b97122c76d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:56.179895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 883/1782] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 18:59:56 2022] POST /identity/v3/projects => generated 399 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 18:59:56.182087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4da2-a956-4405-aa1c-66b97122c76d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:56.204684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1d592-55dc-41e4-93f6-ec8d9765885a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:56.208832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1d592-55dc-41e4-93f6-ec8d9765885a service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:56.229968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 900/1783] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:56.328081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4da2-a956-4405-aa1c-66b97122c76d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:56.338223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431a2f-37c5-4ba8-8059-53d4b826abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:56.339025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431a2f-37c5-4ba8-8059-53d4b826abfd admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:56.339434 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431a2f-37c5-4ba8-8059-53d4b826abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:56.339852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431a2f-37c5-4ba8-8059-53d4b826abfd admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:56.340710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02431a2f-37c5-4ba8-8059-53d4b826abfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:56.343152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02431a2f-37c5-4ba8-8059-53d4b826abfd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:56.378508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 884/1784] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 18:59:56 2022] POST /identity/v3/users => generated 306 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 18:59:56.380088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1d592-55dc-41e4-93f6-ec8d9765885a service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:56.401415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1d592-55dc-41e4-93f6-ec8d9765885a service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:56.408348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abc44f-8460-4787-a5f9-eb43823f9d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:56.409134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abc44f-8460-4787-a5f9-eb43823f9d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:56.409485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abc44f-8460-4787-a5f9-eb43823f9d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:56.409854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abc44f-8460-4787-a5f9-eb43823f9d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:56.415229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abc44f-8460-4787-a5f9-eb43823f9d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:56.417958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abc44f-8460-4787-a5f9-eb43823f9d5f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:56.441060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 901/1785] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 18:59:56.443474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431a2f-37c5-4ba8-8059-53d4b826abfd admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:56.459045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431a2f-37c5-4ba8-8059-53d4b826abfd admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:56.496370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b99d8-5d2b-43e1-815b-b750180e8a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:56.500920 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b99d8-5d2b-43e1-815b-b750180e8a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:56.514985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b99d8-5d2b-43e1-815b-b750180e8a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:56.515338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b99d8-5d2b-43e1-815b-b750180e8a4c admin admin] PATH_INFO: `/v3/projects/8655c23ab1ab4cc3b6cac4c2c67be405/users/cc842e387a3b49cb98452ab2f35a6ddb/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:56.573970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b99d8-5d2b-43e1-815b-b750180e8a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8655c23ab1ab4cc3b6cac4c2c67be405, user_id=cc842e387a3b49cb98452ab2f35a6ddb, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:56.578091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b99d8-5d2b-43e1-815b-b750180e8a4c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:56.602078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 885/1786] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:56 2022] PUT /identity/v3/projects/8655c23ab1ab4cc3b6cac4c2c67be405/users/cc842e387a3b49cb98452ab2f35a6ddb/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:56.606994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abc44f-8460-4787-a5f9-eb43823f9d5f admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:56.621586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abc44f-8460-4787-a5f9-eb43823f9d5f admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:56.765939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3533a5b-e76e-4a35-830b-ab8aba98fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:56.766863 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533a5b-e76e-4a35-830b-ab8aba98fe5f admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:56.767163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533a5b-e76e-4a35-830b-ab8aba98fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:56.767444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533a5b-e76e-4a35-830b-ab8aba98fe5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:56.768178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3533a5b-e76e-4a35-830b-ab8aba98fe5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:56.771727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3533a5b-e76e-4a35-830b-ab8aba98fe5f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:56.798799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 902/1787] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 18:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 18:59:56.802518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b99d8-5d2b-43e1-815b-b750180e8a4c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:56.816149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b99d8-5d2b-43e1-815b-b750180e8a4c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:56.842511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dd2f7-b0ca-4c04-82ef-dfa4228e0905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:56.843424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dd2f7-b0ca-4c04-82ef-dfa4228e0905 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:56.859297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dd2f7-b0ca-4c04-82ef-dfa4228e0905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:56.859665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dd2f7-b0ca-4c04-82ef-dfa4228e0905 admin admin] PATH_INFO: `/v3/projects/8655c23ab1ab4cc3b6cac4c2c67be405/users/cc842e387a3b49cb98452ab2f35a6ddb/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:56.863083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dd2f7-b0ca-4c04-82ef-dfa4228e0905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8655c23ab1ab4cc3b6cac4c2c67be405, user_id=cc842e387a3b49cb98452ab2f35a6ddb, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:56.875075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dd2f7-b0ca-4c04-82ef-dfa4228e0905 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:56.936518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a53ca7-6724-48ec-9c77-f5abd788f5e1 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:56.936727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a53ca7-6724-48ec-9c77-f5abd788f5e1 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:56.937769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a53ca7-6724-48ec-9c77-f5abd788f5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:56.943393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 886/1788] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 18:59:56 2022] PUT /identity/v3/projects/8655c23ab1ab4cc3b6cac4c2c67be405/users/cc842e387a3b49cb98452ab2f35a6ddb/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:57.015181 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-92a53ca7-6724-48ec-9c77-f5abd788f5e1 None None] MFA Rules not processed for user `cc842e387a3b49cb98452ab2f35a6ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:57.023812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-92a53ca7-6724-48ec-9c77-f5abd788f5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:57.294719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 903/1789] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:56 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:57.376943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dd2f7-b0ca-4c04-82ef-dfa4228e0905 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:57.443989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893f294-0b36-424c-ac7d-ec36638d8dce None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:57.444305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893f294-0b36-424c-ac7d-ec36638d8dce None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:57.444536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893f294-0b36-424c-ac7d-ec36638d8dce None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:57.446300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 904/1790] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 18:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 18:59:57.452064 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dd2f7-b0ca-4c04-82ef-dfa4228e0905 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:57.457579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688c20b-a709-4b89-8edb-054832c662b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:57.458673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688c20b-a709-4b89-8edb-054832c662b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:57.459159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688c20b-a709-4b89-8edb-054832c662b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:57.459648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688c20b-a709-4b89-8edb-054832c662b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:57.462647 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623a80-7235-4e1a-983d-62b658b0030b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:57.462935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623a80-7235-4e1a-983d-62b658b0030b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:57.463213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623a80-7235-4e1a-983d-62b658b0030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:57.477148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688c20b-a709-4b89-8edb-054832c662b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:57.479622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688c20b-a709-4b89-8edb-054832c662b8 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:57.497047 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7d623a80-7235-4e1a-983d-62b658b0030b None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:57.501179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7d623a80-7235-4e1a-983d-62b658b0030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:57.521122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 887/1791] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:57 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:57.673906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688c20b-a709-4b89-8edb-054832c662b8 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:57.676432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5688c20b-a709-4b89-8edb-054832c662b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:57.711896 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688c20b-a709-4b89-8edb-054832c662b8 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:57.713643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 905/1792] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 18:59:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 18:59:57.726609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faec26b-e578-42a1-9bdf-bd57209004c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:57.727359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faec26b-e578-42a1-9bdf-bd57209004c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:57.727728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faec26b-e578-42a1-9bdf-bd57209004c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:57.728246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faec26b-e578-42a1-9bdf-bd57209004c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:57.853058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faec26b-e578-42a1-9bdf-bd57209004c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:57.853058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faec26b-e578-42a1-9bdf-bd57209004c4 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:57.869882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 888/1793] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 18:59:58.085015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d623a80-7235-4e1a-983d-62b658b0030b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:58.086503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7d623a80-7235-4e1a-983d-62b658b0030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:58.109951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d623a80-7235-4e1a-983d-62b658b0030b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:58.120937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405858-94c3-4f9e-9357-1d1bd7835063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:58.142688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405858-94c3-4f9e-9357-1d1bd7835063 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:58.143302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405858-94c3-4f9e-9357-1d1bd7835063 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:58.144023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405858-94c3-4f9e-9357-1d1bd7835063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:58.180970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405858-94c3-4f9e-9357-1d1bd7835063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:58.186408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405858-94c3-4f9e-9357-1d1bd7835063 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:58.225208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 906/1794] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 18:59:59.579507 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faec26b-e578-42a1-9bdf-bd57209004c4 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:59.581101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5faec26b-e578-42a1-9bdf-bd57209004c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:59.655387 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faec26b-e578-42a1-9bdf-bd57209004c4 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:59.664557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:59.665811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:59.666287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:59.667010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] PATH_INFO: `/v3/users/7aad8a7e00b6443992dfa490a107a95a` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:59.667907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aad8a7e00b6443992dfa490a107a95a)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:59.669869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:59.732577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aad8a7e00b6443992dfa490a107a95a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:59.751626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aad8a7e00b6443992dfa490a107a95a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:59.758660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aad8a7e00b6443992dfa490a107a95a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:59.759499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aad8a7e00b6443992dfa490a107a95a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:59.767441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aad8a7e00b6443992dfa490a107a95a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 18:59:59.774531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 889/1795] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 18:59:59 2022] DELETE /identity/v3/users/7aad8a7e00b6443992dfa490a107a95a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 18:59:59.778786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135f466-66c6-44de-9e1d-f2f9348e2882 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:59.779273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135f466-66c6-44de-9e1d-f2f9348e2882 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:59.779388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135f466-66c6-44de-9e1d-f2f9348e2882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:59.798553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f135f466-66c6-44de-9e1d-f2f9348e2882 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 18:59:59.800004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f135f466-66c6-44de-9e1d-f2f9348e2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:59.873043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 907/1796] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 18:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 18:59:59.882478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 18:59:59.883920 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 18:59:59.955156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e31ab1-73d2-40c6-afff-b592b9f498b4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 18:59:59.958433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7938ad2-4268-4b1b-a61f-b3e8d3c45d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 18:59:59.959081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7938ad2-4268-4b1b-a61f-b3e8d3c45d83 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 18:59:59.959359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7938ad2-4268-4b1b-a61f-b3e8d3c45d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 18:59:59.959630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7938ad2-4268-4b1b-a61f-b3e8d3c45d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 18:59:59.968852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7938ad2-4268-4b1b-a61f-b3e8d3c45d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 18:59:59.970291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7938ad2-4268-4b1b-a61f-b3e8d3c45d83 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 18:59:59.980455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 890/1797] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 18:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:00.300410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135f466-66c6-44de-9e1d-f2f9348e2882 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:00.302380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f135f466-66c6-44de-9e1d-f2f9348e2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:00.324209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135f466-66c6-44de-9e1d-f2f9348e2882 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:00.330849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:00.332035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:00.332617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:00.333117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] PATH_INFO: `/v3/projects/86a723cc621d4d3b9822bfca79fe2f71` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:00.334652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a723cc621d4d3b9822bfca79fe2f71)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:00.337115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:00.400512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a723cc621d4d3b9822bfca79fe2f71', 'request_id': 'req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.408875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a723cc621d4d3b9822bfca79fe2f71', 'request_id': 'req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.416616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a723cc621d4d3b9822bfca79fe2f71', 'request_id': 'req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.437552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] The token cache is being invalidate because project 86a723cc621d4d3b9822bfca79fe2f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:00.437840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.438531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-abb3e26a-4f0a-4a55-ab18-a2ed493f92c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.440122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 908/1798] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:00 2022] DELETE /identity/v3/projects/86a723cc621d4d3b9822bfca79fe2f71 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:00.444096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7938ad2-4268-4b1b-a61f-b3e8d3c45d83 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:00.454349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7938ad2-4268-4b1b-a61f-b3e8d3c45d83 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:00.536138 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:00.536977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:00.537266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:00.537580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] PATH_INFO: `/v3/users/44aa621571264a809982bc156ed80ab2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:00.538809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44aa621571264a809982bc156ed80ab2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:00.540909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:00.591977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44aa621571264a809982bc156ed80ab2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.603406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44aa621571264a809982bc156ed80ab2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.609911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44aa621571264a809982bc156ed80ab2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.610608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44aa621571264a809982bc156ed80ab2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.619987 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44aa621571264a809982bc156ed80ab2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:00.626943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 891/1799] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:00 2022] DELETE /identity/v3/users/44aa621571264a809982bc156ed80ab2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:00.953367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91b339-57f5-4253-838c-b34694bc5f41 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:00.953367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91b339-57f5-4253-838c-b34694bc5f41 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:00.953367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91b339-57f5-4253-838c-b34694bc5f41 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:00.954591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:00.959148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 909/1800] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 19:00:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 19:00:00.962745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:01.007371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2a91-1430-4eb2-9cbc-b71ee768bd35 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:01.007653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2a91-1430-4eb2-9cbc-b71ee768bd35 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:01.008208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2a91-1430-4eb2-9cbc-b71ee768bd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:01.046789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1b8c2a91-1430-4eb2-9cbc-b71ee768bd35 None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:01.047955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1b8c2a91-1430-4eb2-9cbc-b71ee768bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:01.062792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253af34-41af-4d40-8653-b3bb6b46a55a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:01.071946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:01.073021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:01.073585 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:01.074189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] PATH_INFO: `/v3/projects/3ad9262b52844e08aba4e3290b14a300` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:01.078893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad9262b52844e08aba4e3290b14a300)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:01.085099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:01.211495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 910/1801] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 19:00:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:01.253391 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad9262b52844e08aba4e3290b14a300', 'request_id': 'req-4ff7cc8b-3218-4ae4-9212-4d1753f55393'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.267420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad9262b52844e08aba4e3290b14a300', 'request_id': 'req-4ff7cc8b-3218-4ae4-9212-4d1753f55393'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.277275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad9262b52844e08aba4e3290b14a300', 'request_id': 'req-4ff7cc8b-3218-4ae4-9212-4d1753f55393'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.290892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] The token cache is being invalidate because project 3ad9262b52844e08aba4e3290b14a300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:01.291530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.292297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.293998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 892/1802] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:00 2022] DELETE /identity/v3/projects/3ad9262b52844e08aba4e3290b14a300 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:01.298262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2a91-1430-4eb2-9cbc-b71ee768bd35 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:01.314117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2a91-1430-4eb2-9cbc-b71ee768bd35 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:01.423357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:01.424398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:01.424902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:01.425276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] PATH_INFO: `/v3/users/ed57afe589f44eddab5e6d407f26f033` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:01.426886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed57afe589f44eddab5e6d407f26f033)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:01.429248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:01.482651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed57afe589f44eddab5e6d407f26f033'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.483520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed57afe589f44eddab5e6d407f26f033'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.497464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed57afe589f44eddab5e6d407f26f033'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.498367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed57afe589f44eddab5e6d407f26f033'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.513935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:01.515603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:01.516783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed57afe589f44eddab5e6d407f26f033'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:01.557622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 911/1803] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:01 2022] DELETE /identity/v3/users/ed57afe589f44eddab5e6d407f26f033 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:01.613269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7cc8b-3218-4ae4-9212-4d1753f55393 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:01.692569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54539b03-c180-4971-a4bf-0c420c5ae847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:01.693385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54539b03-c180-4971-a4bf-0c420c5ae847 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:01.693791 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54539b03-c180-4971-a4bf-0c420c5ae847 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:01.694052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54539b03-c180-4971-a4bf-0c420c5ae847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:01.696586 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-54539b03-c180-4971-a4bf-0c420c5ae847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:01.710849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54539b03-c180-4971-a4bf-0c420c5ae847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:01.712466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54539b03-c180-4971-a4bf-0c420c5ae847 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:01.725372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 893/1804] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:01.861686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:01.863153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:01.969786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc45a3-7bbc-4335-b56c-8129a494c509 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:01.994296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:01.995289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:01.995635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:01.996101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] PATH_INFO: `/v3/projects/f8435aeed04c4d9e8ca315a79725b8ad` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:01.999093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8435aeed04c4d9e8ca315a79725b8ad)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:02.002329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:02.173926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8435aeed04c4d9e8ca315a79725b8ad', 'request_id': 'req-c4c861cb-11da-459b-879b-1f9bbc1c7fac'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.194570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8435aeed04c4d9e8ca315a79725b8ad', 'request_id': 'req-c4c861cb-11da-459b-879b-1f9bbc1c7fac'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.203777 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8435aeed04c4d9e8ca315a79725b8ad', 'request_id': 'req-c4c861cb-11da-459b-879b-1f9bbc1c7fac'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.229100 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] The token cache is being invalidate because project f8435aeed04c4d9e8ca315a79725b8ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:02.229570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.230217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c4c861cb-11da-459b-879b-1f9bbc1c7fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.232164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 912/1805] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:01 2022] DELETE /identity/v3/projects/f8435aeed04c4d9e8ca315a79725b8ad => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:02.241559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee10a8e-0962-45e1-aa86-46e1f4de66af None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:02.242020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee10a8e-0962-45e1-aa86-46e1f4de66af None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:02.242465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee10a8e-0962-45e1-aa86-46e1f4de66af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:02.297467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1ee10a8e-0962-45e1-aa86-46e1f4de66af None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:02.301510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1ee10a8e-0962-45e1-aa86-46e1f4de66af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:02.474295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 894/1806] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:02.483580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842771a-1e77-4ad8-911c-d95643306963 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:02.483965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842771a-1e77-4ad8-911c-d95643306963 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:02.484325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842771a-1e77-4ad8-911c-d95643306963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:02.525558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4842771a-1e77-4ad8-911c-d95643306963 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:02.526985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4842771a-1e77-4ad8-911c-d95643306963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:02.547091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 913/1807] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:02.551484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee10a8e-0962-45e1-aa86-46e1f4de66af None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:02.562246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee10a8e-0962-45e1-aa86-46e1f4de66af None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:02.563572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842771a-1e77-4ad8-911c-d95643306963 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:02.566364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4842771a-1e77-4ad8-911c-d95643306963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:02.586341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f46f0-ce19-4dfc-9b92-1823693c4244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:02.587800 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f46f0-ce19-4dfc-9b92-1823693c4244 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:02.588295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f46f0-ce19-4dfc-9b92-1823693c4244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:02.588707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f46f0-ce19-4dfc-9b92-1823693c4244 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:02.589653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f46f0-ce19-4dfc-9b92-1823693c4244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:02.590281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f46f0-ce19-4dfc-9b92-1823693c4244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:02.591067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842771a-1e77-4ad8-911c-d95643306963 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:02.596241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f46f0-ce19-4dfc-9b92-1823693c4244 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:02.607801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:02.608815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:02.609195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:02.609588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] PATH_INFO: `/v3/users/8206aa3f9fee4dec848b4a2e8901af0e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:02.611801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8206aa3f9fee4dec848b4a2e8901af0e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:02.614772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:02.615090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 895/1808] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:00:02.616501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f46f0-ce19-4dfc-9b92-1823693c4244 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:02.631880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f46f0-ce19-4dfc-9b92-1823693c4244 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:02.639916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bf331-61b8-412a-8407-5de9d39462f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:02.640794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bf331-61b8-412a-8407-5de9d39462f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:02.641304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bf331-61b8-412a-8407-5de9d39462f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:02.641901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bf331-61b8-412a-8407-5de9d39462f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:02.642608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bf331-61b8-412a-8407-5de9d39462f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:02.645748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bf331-61b8-412a-8407-5de9d39462f8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:02.684798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 896/1809] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:02 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:02.694803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bf331-61b8-412a-8407-5de9d39462f8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:02.697953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8206aa3f9fee4dec848b4a2e8901af0e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.699064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8206aa3f9fee4dec848b4a2e8901af0e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.715594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8206aa3f9fee4dec848b4a2e8901af0e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.716521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8206aa3f9fee4dec848b4a2e8901af0e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.728409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ee004a31-6c4b-4712-856d-bca559cb61ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8206aa3f9fee4dec848b4a2e8901af0e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:02.759555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 914/1810] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:02 2022] DELETE /identity/v3/users/8206aa3f9fee4dec848b4a2e8901af0e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:02.761175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987b386-4d6d-448e-813a-c8d0e9dabed7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:02.763723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987b386-4d6d-448e-813a-c8d0e9dabed7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:02.764099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987b386-4d6d-448e-813a-c8d0e9dabed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:02.796713 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4987b386-4d6d-448e-813a-c8d0e9dabed7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:02.797958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4987b386-4d6d-448e-813a-c8d0e9dabed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:02.799074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bf331-61b8-412a-8407-5de9d39462f8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:02.882849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98a50-d795-481a-9619-e300145886ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:02.890034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 915/1811] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:02.893283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98a50-d795-481a-9619-e300145886ee admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:02.893554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98a50-d795-481a-9619-e300145886ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:02.893847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98a50-d795-481a-9619-e300145886ee admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:02.895127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98a50-d795-481a-9619-e300145886ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:02.897070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98a50-d795-481a-9619-e300145886ee admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:02.911910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987b386-4d6d-448e-813a-c8d0e9dabed7 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:02.913368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4987b386-4d6d-448e-813a-c8d0e9dabed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:02.939220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 897/1812] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:02 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:02.943567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98a50-d795-481a-9619-e300145886ee admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:02.947096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5cb98a50-d795-481a-9619-e300145886ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:02.969443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98a50-d795-481a-9619-e300145886ee admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:02.976761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075fd96-8bb5-4319-a4af-c3b5cfd03bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:02.978406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075fd96-8bb5-4319-a4af-c3b5cfd03bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:02.978876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075fd96-8bb5-4319-a4af-c3b5cfd03bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:02.979305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075fd96-8bb5-4319-a4af-c3b5cfd03bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:02.980234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075fd96-8bb5-4319-a4af-c3b5cfd03bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:02.982659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075fd96-8bb5-4319-a4af-c3b5cfd03bc6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:02.994479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 898/1813] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:02.998777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075fd96-8bb5-4319-a4af-c3b5cfd03bc6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.001936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987b386-4d6d-448e-813a-c8d0e9dabed7 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:03.008392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019b194-5ad4-4f08-b7f7-ccb9dcfd3763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:03.009343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019b194-5ad4-4f08-b7f7-ccb9dcfd3763 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.009902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019b194-5ad4-4f08-b7f7-ccb9dcfd3763 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.010318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019b194-5ad4-4f08-b7f7-ccb9dcfd3763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.014448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075fd96-8bb5-4319-a4af-c3b5cfd03bc6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:03.021475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ecc02-19ae-4c7f-b91f-57f0538bd2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:03.022446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ecc02-19ae-4c7f-b91f-57f0538bd2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.022583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019b194-5ad4-4f08-b7f7-ccb9dcfd3763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:03.023009 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ecc02-19ae-4c7f-b91f-57f0538bd2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.023532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ecc02-19ae-4c7f-b91f-57f0538bd2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.023980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019b194-5ad4-4f08-b7f7-ccb9dcfd3763 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:03.024778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ecc02-19ae-4c7f-b91f-57f0538bd2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:03.026776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ecc02-19ae-4c7f-b91f-57f0538bd2d0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:03.037876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 916/1814] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:03.042170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 899/1815] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:03.046246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019b194-5ad4-4f08-b7f7-ccb9dcfd3763 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.056779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019b194-5ad4-4f08-b7f7-ccb9dcfd3763 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:03.063588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f0bd0-975a-4900-a31e-8af68619f504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:03.064740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f0bd0-975a-4900-a31e-8af68619f504 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.065206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f0bd0-975a-4900-a31e-8af68619f504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.065709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f0bd0-975a-4900-a31e-8af68619f504 admin admin] PATH_INFO: `/v3/projects/12d50950ebc04aa99f4189812a1e9aa0/users/c25ed6b1340745509b2d6fa72f152192/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.083788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f0bd0-975a-4900-a31e-8af68619f504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d50950ebc04aa99f4189812a1e9aa0, user_id=c25ed6b1340745509b2d6fa72f152192, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:03.086889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f0bd0-975a-4900-a31e-8af68619f504 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:03.114511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 917/1816] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:03 2022] PUT /identity/v3/projects/12d50950ebc04aa99f4189812a1e9aa0/users/c25ed6b1340745509b2d6fa72f152192/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:03.116575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baf827-8c17-44e5-95ea-4e044400ddeb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.116881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baf827-8c17-44e5-95ea-4e044400ddeb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.117147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baf827-8c17-44e5-95ea-4e044400ddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.150025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-61baf827-8c17-44e5-95ea-4e044400ddeb None None] MFA Rules not processed for user `c25ed6b1340745509b2d6fa72f152192`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:03.151532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-61baf827-8c17-44e5-95ea-4e044400ddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:03.226794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 900/1817] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:03.231571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f0bd0-975a-4900-a31e-8af68619f504 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.309625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f0bd0-975a-4900-a31e-8af68619f504 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:03.315033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cac37-6779-4d53-9978-8d518d0e6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:03.315699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cac37-6779-4d53-9978-8d518d0e6967 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.315981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cac37-6779-4d53-9978-8d518d0e6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.316256 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cac37-6779-4d53-9978-8d518d0e6967 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.317738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cac37-6779-4d53-9978-8d518d0e6967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:03.319412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cac37-6779-4d53-9978-8d518d0e6967 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:03.350438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 918/1818] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:03 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:03.351579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baf827-8c17-44e5-95ea-4e044400ddeb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.363575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baf827-8c17-44e5-95ea-4e044400ddeb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:03.460321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61447a2-d5d5-4730-9740-b4fd7d11088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:03.461445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61447a2-d5d5-4730-9740-b4fd7d11088b admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.461908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61447a2-d5d5-4730-9740-b4fd7d11088b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.462335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61447a2-d5d5-4730-9740-b4fd7d11088b admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.464098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61447a2-d5d5-4730-9740-b4fd7d11088b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:03.467812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61447a2-d5d5-4730-9740-b4fd7d11088b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:03.497846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 901/1819] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:03 2022] POST /identity/v3/users => generated 302 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:03.500210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cac37-6779-4d53-9978-8d518d0e6967 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.512734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cac37-6779-4d53-9978-8d518d0e6967 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:03.518539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a32435-fb87-4871-8bbc-c9fc52cc37b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:03.519442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a32435-fb87-4871-8bbc-c9fc52cc37b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.519839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a32435-fb87-4871-8bbc-c9fc52cc37b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.520189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a32435-fb87-4871-8bbc-c9fc52cc37b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.521266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a32435-fb87-4871-8bbc-c9fc52cc37b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:03.523119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a32435-fb87-4871-8bbc-c9fc52cc37b0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:03.535091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 919/1820] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:03.539543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61447a2-d5d5-4730-9740-b4fd7d11088b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.550400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61447a2-d5d5-4730-9740-b4fd7d11088b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:03.555547 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7df43e-7ea8-437e-8da7-d74600e6077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:03.556516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7df43e-7ea8-437e-8da7-d74600e6077b admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.556897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7df43e-7ea8-437e-8da7-d74600e6077b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.557240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7df43e-7ea8-437e-8da7-d74600e6077b admin admin] PATH_INFO: `/v3/projects/f2a7e47f4fb54ef088b9496d8fc93ff6/users/25e70efe31524723afd644bab5bb306a/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.574112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7df43e-7ea8-437e-8da7-d74600e6077b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a7e47f4fb54ef088b9496d8fc93ff6, user_id=25e70efe31524723afd644bab5bb306a, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:03.576919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7df43e-7ea8-437e-8da7-d74600e6077b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:03.592792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 902/1821] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:03 2022] PUT /identity/v3/projects/f2a7e47f4fb54ef088b9496d8fc93ff6/users/25e70efe31524723afd644bab5bb306a/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:03.596868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a32435-fb87-4871-8bbc-c9fc52cc37b0 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.608320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a32435-fb87-4871-8bbc-c9fc52cc37b0 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:03.680456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe573657-076a-4de8-9067-c55b9643c922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:03.681177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe573657-076a-4de8-9067-c55b9643c922 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.681782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe573657-076a-4de8-9067-c55b9643c922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.682263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe573657-076a-4de8-9067-c55b9643c922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.683151 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe573657-076a-4de8-9067-c55b9643c922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:03.685244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe573657-076a-4de8-9067-c55b9643c922 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:03.702725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 920/1822] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:03.706924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7df43e-7ea8-437e-8da7-d74600e6077b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.718450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7df43e-7ea8-437e-8da7-d74600e6077b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:03.726414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d177b-cb03-4dcf-9fad-2fd9ca3cc149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:03.727427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d177b-cb03-4dcf-9fad-2fd9ca3cc149 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.727899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d177b-cb03-4dcf-9fad-2fd9ca3cc149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.728329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d177b-cb03-4dcf-9fad-2fd9ca3cc149 admin admin] PATH_INFO: `/v3/projects/f2a7e47f4fb54ef088b9496d8fc93ff6/users/25e70efe31524723afd644bab5bb306a/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.731767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d177b-cb03-4dcf-9fad-2fd9ca3cc149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a7e47f4fb54ef088b9496d8fc93ff6, user_id=25e70efe31524723afd644bab5bb306a, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:03.734601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d177b-cb03-4dcf-9fad-2fd9ca3cc149 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:03.747366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 903/1823] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:03 2022] PUT /identity/v3/projects/f2a7e47f4fb54ef088b9496d8fc93ff6/users/25e70efe31524723afd644bab5bb306a/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:03.758778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de68ad7-cdfe-49af-86c7-d2d39a4e31cd None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:03.759684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de68ad7-cdfe-49af-86c7-d2d39a4e31cd None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:03.760063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de68ad7-cdfe-49af-86c7-d2d39a4e31cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:03.795448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7de68ad7-cdfe-49af-86c7-d2d39a4e31cd None None] MFA Rules not processed for user `25e70efe31524723afd644bab5bb306a`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:03.796995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7de68ad7-cdfe-49af-86c7-d2d39a4e31cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:03.907431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 921/1824] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:03.908295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d177b-cb03-4dcf-9fad-2fd9ca3cc149 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.910955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-752d177b-cb03-4dcf-9fad-2fd9ca3cc149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:03.985857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de68ad7-cdfe-49af-86c7-d2d39a4e31cd None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:03.987822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7de68ad7-cdfe-49af-86c7-d2d39a4e31cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:04.029286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d177b-cb03-4dcf-9fad-2fd9ca3cc149 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:04.033804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc59cc-3f57-4471-89cd-aa8835228925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:04.038602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc59cc-3f57-4471-89cd-aa8835228925 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:04.038890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc59cc-3f57-4471-89cd-aa8835228925 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:04.039167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc59cc-3f57-4471-89cd-aa8835228925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:04.053970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc59cc-3f57-4471-89cd-aa8835228925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:04.055479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc59cc-3f57-4471-89cd-aa8835228925 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:04.080127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 904/1825] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:00:04.210795 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de68ad7-cdfe-49af-86c7-d2d39a4e31cd None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:04.214827 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc59cc-3f57-4471-89cd-aa8835228925 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:04.228290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc59cc-3f57-4471-89cd-aa8835228925 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:04.235126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:04.236249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:04.236249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:04.236534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] PATH_INFO: `/v3/projects/0b3adb30338948b580fdcf5e95dc205c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:04.239186 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f198-3ca9-4b15-8a51-b07bca9dea23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:04.240066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f198-3ca9-4b15-8a51-b07bca9dea23 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:04.240263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f198-3ca9-4b15-8a51-b07bca9dea23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:04.240539 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f198-3ca9-4b15-8a51-b07bca9dea23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:04.241989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3adb30338948b580fdcf5e95dc205c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:04.251744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:04.361134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3adb30338948b580fdcf5e95dc205c', 'request_id': 'req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.379150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3adb30338948b580fdcf5e95dc205c', 'request_id': 'req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.387828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9f198-3ca9-4b15-8a51-b07bca9dea23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:04.389415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9f198-3ca9-4b15-8a51-b07bca9dea23 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:04.390097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3adb30338948b580fdcf5e95dc205c', 'request_id': 'req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.409121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] The token cache is being invalidate because project 0b3adb30338948b580fdcf5e95dc205c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:04.409392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.411516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 905/1826] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:04.412224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.416784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 922/1827] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:03 2022] DELETE /identity/v3/projects/0b3adb30338948b580fdcf5e95dc205c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:04.418024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f198-3ca9-4b15-8a51-b07bca9dea23 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:04.436189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f198-3ca9-4b15-8a51-b07bca9dea23 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:04.530709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:04.531699 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:04.532052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:04.532395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] PATH_INFO: `/v3/users/cc842e387a3b49cb98452ab2f35a6ddb` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:04.533770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc842e387a3b49cb98452ab2f35a6ddb)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:04.536421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:04.624883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc842e387a3b49cb98452ab2f35a6ddb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.639281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc842e387a3b49cb98452ab2f35a6ddb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.648525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc842e387a3b49cb98452ab2f35a6ddb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.649317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc842e387a3b49cb98452ab2f35a6ddb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.657395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c6fb8e07-e5fa-4893-bfa5-497ffc4071d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc842e387a3b49cb98452ab2f35a6ddb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:04.666381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 906/1828] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:04 2022] DELETE /identity/v3/users/cc842e387a3b49cb98452ab2f35a6ddb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:05.057795 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:05.061025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:05.075670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddeaee-8c1f-4947-b9f0-379f9bcdb576 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:05.141474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:05.142527 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.143061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.143061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] PATH_INFO: `/v3/projects/8655c23ab1ab4cc3b6cac4c2c67be405` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.144207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8655c23ab1ab4cc3b6cac4c2c67be405)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:05.146166 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:05.221733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8655c23ab1ab4cc3b6cac4c2c67be405', 'request_id': 'req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:05.235818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8655c23ab1ab4cc3b6cac4c2c67be405', 'request_id': 'req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:05.253560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8655c23ab1ab4cc3b6cac4c2c67be405', 'request_id': 'req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:05.270900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] The token cache is being invalidate because project 8655c23ab1ab4cc3b6cac4c2c67be405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:05.271197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:05.272241 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9b6a4c91-f7bf-42a3-b6f4-35e5e15f654f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:05.274745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 923/1829] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:05 2022] DELETE /identity/v3/projects/8655c23ab1ab4cc3b6cac4c2c67be405 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:05.279204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbb8aa-3e0a-49bb-96fd-501367514f8c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.279678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbb8aa-3e0a-49bb-96fd-501367514f8c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.279884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbb8aa-3e0a-49bb-96fd-501367514f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.307355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-52bbb8aa-3e0a-49bb-96fd-501367514f8c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:05.309211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-52bbb8aa-3e0a-49bb-96fd-501367514f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:05.389768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 907/1830] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:05.398274 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22568c-2c18-41f9-bbe6-56b3c558f8cc None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.398547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22568c-2c18-41f9-bbe6-56b3c558f8cc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.398822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22568c-2c18-41f9-bbe6-56b3c558f8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.428607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-de22568c-2c18-41f9-bbe6-56b3c558f8cc None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:05.430445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-de22568c-2c18-41f9-bbe6-56b3c558f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:05.438950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 924/1831] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:05.443198 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbb8aa-3e0a-49bb-96fd-501367514f8c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:05.452880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbb8aa-3e0a-49bb-96fd-501367514f8c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:05.458480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647e6fa-f537-45a6-8ee7-d992e3c7b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:05.459134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647e6fa-f537-45a6-8ee7-d992e3c7b39a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.459412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647e6fa-f537-45a6-8ee7-d992e3c7b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.459687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647e6fa-f537-45a6-8ee7-d992e3c7b39a admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.460520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647e6fa-f537-45a6-8ee7-d992e3c7b39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:05.461005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647e6fa-f537-45a6-8ee7-d992e3c7b39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:05.462672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647e6fa-f537-45a6-8ee7-d992e3c7b39a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:05.476353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 908/1832] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:00:05.481014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22568c-2c18-41f9-bbe6-56b3c558f8cc None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:05.492769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22568c-2c18-41f9-bbe6-56b3c558f8cc None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:05.497636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ffb27-f0cf-4ab1-892a-1e405f29de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:05.498543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ffb27-f0cf-4ab1-892a-1e405f29de13 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.498828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ffb27-f0cf-4ab1-892a-1e405f29de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.499103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ffb27-f0cf-4ab1-892a-1e405f29de13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.499837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ffb27-f0cf-4ab1-892a-1e405f29de13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:05.501825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ffb27-f0cf-4ab1-892a-1e405f29de13 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:05.533934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 925/1833] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:05 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:05.539398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647e6fa-f537-45a6-8ee7-d992e3c7b39a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:05.550143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647e6fa-f537-45a6-8ee7-d992e3c7b39a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:05.612762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47993ae9-455e-40a5-ba64-bbc94f542f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:05.614085 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993ae9-455e-40a5-ba64-bbc94f542f28 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.614443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993ae9-455e-40a5-ba64-bbc94f542f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.614812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993ae9-455e-40a5-ba64-bbc94f542f28 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.615561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47993ae9-455e-40a5-ba64-bbc94f542f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:05.617724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47993ae9-455e-40a5-ba64-bbc94f542f28 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:05.647604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 909/1834] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:05 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:05.649063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ffb27-f0cf-4ab1-892a-1e405f29de13 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:05.666639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ffb27-f0cf-4ab1-892a-1e405f29de13 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:05.682087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d168-79c1-4165-be15-5d65223606fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:05.682872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d168-79c1-4165-be15-5d65223606fc admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.684517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d168-79c1-4165-be15-5d65223606fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.684865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d168-79c1-4165-be15-5d65223606fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.687171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224d168-79c1-4165-be15-5d65223606fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:05.691189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224d168-79c1-4165-be15-5d65223606fc admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:05.719920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 926/1835] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:05.721123 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47993ae9-455e-40a5-ba64-bbc94f542f28 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:05.743919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47993ae9-455e-40a5-ba64-bbc94f542f28 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:05.751053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494c728-3c9e-4ab7-9629-2b51ba0b9df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:05.751810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c728-3c9e-4ab7-9629-2b51ba0b9df1 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.754678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c728-3c9e-4ab7-9629-2b51ba0b9df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.754995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c728-3c9e-4ab7-9629-2b51ba0b9df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.755661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494c728-3c9e-4ab7-9629-2b51ba0b9df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:05.757616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494c728-3c9e-4ab7-9629-2b51ba0b9df1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:05.772248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 910/1836] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:05.776965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d168-79c1-4165-be15-5d65223606fc admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:05.792422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d168-79c1-4165-be15-5d65223606fc admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:05.798538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593eea8-8132-4280-95d3-fe45fa674e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:05.799931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593eea8-8132-4280-95d3-fe45fa674e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.800599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593eea8-8132-4280-95d3-fe45fa674e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.800948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593eea8-8132-4280-95d3-fe45fa674e2e admin admin] PATH_INFO: `/v3/projects/588de8c484fa45d5b6385826cc8f2387/users/5534e4d3353d446d9832032fe1f17b2c/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.861636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593eea8-8132-4280-95d3-fe45fa674e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=588de8c484fa45d5b6385826cc8f2387, user_id=5534e4d3353d446d9832032fe1f17b2c, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:05.864516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593eea8-8132-4280-95d3-fe45fa674e2e admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:05.905962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 927/1837] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:05 2022] PUT /identity/v3/projects/588de8c484fa45d5b6385826cc8f2387/users/5534e4d3353d446d9832032fe1f17b2c/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:05.907106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c84e9-0395-48b6-9a59-9bc2414f688e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:05.907787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c84e9-0395-48b6-9a59-9bc2414f688e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:05.908373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c84e9-0395-48b6-9a59-9bc2414f688e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:05.960257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-293c84e9-0395-48b6-9a59-9bc2414f688e None None] MFA Rules not processed for user `5534e4d3353d446d9832032fe1f17b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:05.963379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-293c84e9-0395-48b6-9a59-9bc2414f688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:06.001034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593eea8-8132-4280-95d3-fe45fa674e2e admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.002997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7593eea8-8132-4280-95d3-fe45fa674e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:06.073501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 911/1838] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:06.075785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c84e9-0395-48b6-9a59-9bc2414f688e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.084304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593eea8-8132-4280-95d3-fe45fa674e2e admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:06.088654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c84e9-0395-48b6-9a59-9bc2414f688e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:06.089385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:06.090298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.090844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.091122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] PATH_INFO: `/v3/users/a18f546f762b4b4ebc4f86a871f69da3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.092388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18f546f762b4b4ebc4f86a871f69da3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:06.095017 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:06.095180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f58c6-7789-49be-9214-83dd4fe031dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:06.095908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f58c6-7789-49be-9214-83dd4fe031dc admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.096202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f58c6-7789-49be-9214-83dd4fe031dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.096617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f58c6-7789-49be-9214-83dd4fe031dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.097179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f58c6-7789-49be-9214-83dd4fe031dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:06.099954 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f58c6-7789-49be-9214-83dd4fe031dc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:06.142323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 912/1839] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:06 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:06.153863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f58c6-7789-49be-9214-83dd4fe031dc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.188930 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18f546f762b4b4ebc4f86a871f69da3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:06.189876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18f546f762b4b4ebc4f86a871f69da3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:06.213793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18f546f762b4b4ebc4f86a871f69da3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:06.220802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18f546f762b4b4ebc4f86a871f69da3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:06.244902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-da0efb89-d22b-45ad-9e52-b686b37b4140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18f546f762b4b4ebc4f86a871f69da3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:06.265607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 928/1840] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:05 2022] DELETE /identity/v3/users/a18f546f762b4b4ebc4f86a871f69da3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:06.271562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fae3c-8b63-411e-ba6c-5fe04a09fc1a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.272021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fae3c-8b63-411e-ba6c-5fe04a09fc1a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.272433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fae3c-8b63-411e-ba6c-5fe04a09fc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.290591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-0d9fae3c-8b63-411e-ba6c-5fe04a09fc1a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:06.292269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0d9fae3c-8b63-411e-ba6c-5fe04a09fc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:06.304085 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f58c6-7789-49be-9214-83dd4fe031dc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:06.368872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 929/1841] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:06.380799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fae3c-8b63-411e-ba6c-5fe04a09fc1a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.382466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0d9fae3c-8b63-411e-ba6c-5fe04a09fc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:06.383918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734d276-78c3-4762-b867-c697ba282a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:06.384760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734d276-78c3-4762-b867-c697ba282a9d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.385112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734d276-78c3-4762-b867-c697ba282a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.385480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734d276-78c3-4762-b867-c697ba282a9d admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.386366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734d276-78c3-4762-b867-c697ba282a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:06.389573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734d276-78c3-4762-b867-c697ba282a9d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:06.442161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 913/1842] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:06 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:06.447451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734d276-78c3-4762-b867-c697ba282a9d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.451940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9734d276-78c3-4762-b867-c697ba282a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:06.465008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fae3c-8b63-411e-ba6c-5fe04a09fc1a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:06.474064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30281-fade-4c0e-9186-938a049fcace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:06.474967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30281-fade-4c0e-9186-938a049fcace service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.475414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30281-fade-4c0e-9186-938a049fcace service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.475698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30281-fade-4c0e-9186-938a049fcace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.478496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734d276-78c3-4762-b867-c697ba282a9d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:06.489542 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f30281-fade-4c0e-9186-938a049fcace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:06.490502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0377a7-bf2b-4cca-9ec0-798bd544d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:06.491193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0377a7-bf2b-4cca-9ec0-798bd544d710 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.491482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0377a7-bf2b-4cca-9ec0-798bd544d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.491761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0377a7-bf2b-4cca-9ec0-798bd544d710 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.492504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0377a7-bf2b-4cca-9ec0-798bd544d710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:06.495063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f30281-fade-4c0e-9186-938a049fcace service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:06.495666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0377a7-bf2b-4cca-9ec0-798bd544d710 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:06.509222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 930/1843] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:06.520588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 914/1844] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:06.524895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30281-fade-4c0e-9186-938a049fcace service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.535899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30281-fade-4c0e-9186-938a049fcace service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:06.541216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36095e-ee7b-4ece-9141-5178988f38aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:06.542266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36095e-ee7b-4ece-9141-5178988f38aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.542550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36095e-ee7b-4ece-9141-5178988f38aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.543036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36095e-ee7b-4ece-9141-5178988f38aa admin admin] PATH_INFO: `/v3/projects/005a1be36a7f4c7297be299ada212be7/users/e4d332ee73814dc7946d17acf02c09b6/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.571768 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36095e-ee7b-4ece-9141-5178988f38aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=005a1be36a7f4c7297be299ada212be7, user_id=e4d332ee73814dc7946d17acf02c09b6, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:06.574571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36095e-ee7b-4ece-9141-5178988f38aa admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:06.598852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 931/1845] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:06 2022] PUT /identity/v3/projects/005a1be36a7f4c7297be299ada212be7/users/e4d332ee73814dc7946d17acf02c09b6/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:06.602958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0377a7-bf2b-4cca-9ec0-798bd544d710 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.620045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0377a7-bf2b-4cca-9ec0-798bd544d710 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:06.713744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b8350-c26d-4370-b73a-4393c65bfc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:06.714603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8350-c26d-4370-b73a-4393c65bfc1a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.714957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8350-c26d-4370-b73a-4393c65bfc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.715341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8350-c26d-4370-b73a-4393c65bfc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.716335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b8350-c26d-4370-b73a-4393c65bfc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:06.718854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b8350-c26d-4370-b73a-4393c65bfc1a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:06.731946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 915/1846] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:06.735984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36095e-ee7b-4ece-9141-5178988f38aa admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.746835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36095e-ee7b-4ece-9141-5178988f38aa admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:06.754939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85488c09-5df4-4267-b601-aff0bc7570c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:06.755938 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85488c09-5df4-4267-b601-aff0bc7570c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.756283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85488c09-5df4-4267-b601-aff0bc7570c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.756623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85488c09-5df4-4267-b601-aff0bc7570c3 admin admin] PATH_INFO: `/v3/projects/005a1be36a7f4c7297be299ada212be7/users/e4d332ee73814dc7946d17acf02c09b6/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.759699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85488c09-5df4-4267-b601-aff0bc7570c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005a1be36a7f4c7297be299ada212be7, user_id=e4d332ee73814dc7946d17acf02c09b6, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:06.762445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85488c09-5df4-4267-b601-aff0bc7570c3 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:06.778780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 932/1847] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:06 2022] PUT /identity/v3/projects/005a1be36a7f4c7297be299ada212be7/users/e4d332ee73814dc7946d17acf02c09b6/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:06.790038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d1294-8e50-4d63-aca8-57a6730c1a64 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.790334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d1294-8e50-4d63-aca8-57a6730c1a64 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.791255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d1294-8e50-4d63-aca8-57a6730c1a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.821108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-341d1294-8e50-4d63-aca8-57a6730c1a64 None None] MFA Rules not processed for user `e4d332ee73814dc7946d17acf02c09b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:06.822425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-341d1294-8e50-4d63-aca8-57a6730c1a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:06.885013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85488c09-5df4-4267-b601-aff0bc7570c3 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.886775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-85488c09-5df4-4267-b601-aff0bc7570c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:06.908872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 916/1848] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:06.922064 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d1294-8e50-4d63-aca8-57a6730c1a64 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:06.923792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-341d1294-8e50-4d63-aca8-57a6730c1a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:06.973567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85488c09-5df4-4267-b601-aff0bc7570c3 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:06.978257 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:06.979188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:06.979543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:06.979885 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] PATH_INFO: `/v3/projects/32772416f8a24240be41b6df1c52e3b2` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:06.981230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32772416f8a24240be41b6df1c52e3b2)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:06.983233 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:06.996917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d1294-8e50-4d63-aca8-57a6730c1a64 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:07.000943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6d4d-83cb-4214-a508-65fc21a701cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:07.001829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6d4d-83cb-4214-a508-65fc21a701cb service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:07.002331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6d4d-83cb-4214-a508-65fc21a701cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:07.002898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6d4d-83cb-4214-a508-65fc21a701cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:07.016253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef6d4d-83cb-4214-a508-65fc21a701cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:07.018368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef6d4d-83cb-4214-a508-65fc21a701cb service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:07.030779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 917/1849] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:00:07.047025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32772416f8a24240be41b6df1c52e3b2', 'request_id': 'req-cad5f728-e5fc-4d27-838a-f02ad28858c8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.064530 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32772416f8a24240be41b6df1c52e3b2', 'request_id': 'req-cad5f728-e5fc-4d27-838a-f02ad28858c8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.072641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32772416f8a24240be41b6df1c52e3b2', 'request_id': 'req-cad5f728-e5fc-4d27-838a-f02ad28858c8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.086849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] The token cache is being invalidate because project 32772416f8a24240be41b6df1c52e3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:07.087254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.088003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.091253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 933/1850] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:06 2022] DELETE /identity/v3/projects/32772416f8a24240be41b6df1c52e3b2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:07.095160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6d4d-83cb-4214-a508-65fc21a701cb service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:07.107804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6d4d-83cb-4214-a508-65fc21a701cb service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:07.148730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:07.150941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:07.211419 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:07.212304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:07.212587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:07.212865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] PATH_INFO: `/v3/users/6c8c3c01dafe42dab8b442b44b7febdb` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:07.214260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8c3c01dafe42dab8b442b44b7febdb)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:07.216184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:07.232039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5f728-e5fc-4d27-838a-f02ad28858c8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:07.237429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a4e20-9a25-44d2-99bc-8179ab3b5a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:07.238261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a4e20-9a25-44d2-99bc-8179ab3b5a3d service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:07.238500 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a4e20-9a25-44d2-99bc-8179ab3b5a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:07.239918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a4e20-9a25-44d2-99bc-8179ab3b5a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:07.244753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c18a4e20-9a25-44d2-99bc-8179ab3b5a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:07.280399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8c3c01dafe42dab8b442b44b7febdb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.302894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8c3c01dafe42dab8b442b44b7febdb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.313796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8c3c01dafe42dab8b442b44b7febdb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.315044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8c3c01dafe42dab8b442b44b7febdb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.324126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a4e20-9a25-44d2-99bc-8179ab3b5a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:07.325068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8c3c01dafe42dab8b442b44b7febdb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.325999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a4e20-9a25-44d2-99bc-8179ab3b5a3d service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:07.333101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 918/1851] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:07 2022] DELETE /identity/v3/users/6c8c3c01dafe42dab8b442b44b7febdb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:07.339239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 934/1852] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:07.794418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:07.795847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:07.864362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff3649-8032-4cb3-9f67-0244990cceaf admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:07.868984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:07.869868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:07.870149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:07.870421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] PATH_INFO: `/v3/projects/967a79dd5e174fdb97f559625547c0cc` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:07.871598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967a79dd5e174fdb97f559625547c0cc)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:07.873501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:07.918857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967a79dd5e174fdb97f559625547c0cc', 'request_id': 'req-10bebb47-d856-4186-9c5b-1cd392cf0570'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.926916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967a79dd5e174fdb97f559625547c0cc', 'request_id': 'req-10bebb47-d856-4186-9c5b-1cd392cf0570'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.932501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967a79dd5e174fdb97f559625547c0cc', 'request_id': 'req-10bebb47-d856-4186-9c5b-1cd392cf0570'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.943674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] The token cache is being invalidate because project 967a79dd5e174fdb97f559625547c0cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:07.943989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.944628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-10bebb47-d856-4186-9c5b-1cd392cf0570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:07.946209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 919/1853] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:07 2022] DELETE /identity/v3/projects/967a79dd5e174fdb97f559625547c0cc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:07.951108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981b8e-bd5a-45d7-b979-fcbb41685ded None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:07.951610 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981b8e-bd5a-45d7-b979-fcbb41685ded None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:07.951890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981b8e-bd5a-45d7-b979-fcbb41685ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:07.969723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-31981b8e-bd5a-45d7-b979-fcbb41685ded None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:07.970936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-31981b8e-bd5a-45d7-b979-fcbb41685ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:08.029010 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 935/1854] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:08.036574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded538d-add8-40a3-995d-f0bf1185190e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.036861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded538d-add8-40a3-995d-f0bf1185190e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.037142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded538d-add8-40a3-995d-f0bf1185190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.055605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fded538d-add8-40a3-995d-f0bf1185190e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:08.056808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fded538d-add8-40a3-995d-f0bf1185190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:08.064773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 920/1855] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:08.069420 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31981b8e-bd5a-45d7-b979-fcbb41685ded None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.078824 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31981b8e-bd5a-45d7-b979-fcbb41685ded None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.083382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee181c-f609-4087-86a7-8d94c87d80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.084034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee181c-f609-4087-86a7-8d94c87d80a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.084303 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee181c-f609-4087-86a7-8d94c87d80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.085203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee181c-f609-4087-86a7-8d94c87d80a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.085970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee181c-f609-4087-86a7-8d94c87d80a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:08.086274 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee181c-f609-4087-86a7-8d94c87d80a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.087900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee181c-f609-4087-86a7-8d94c87d80a1 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.099199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 936/1856] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:08.104622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded538d-add8-40a3-995d-f0bf1185190e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.114459 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded538d-add8-40a3-995d-f0bf1185190e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.119014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54e4d-a71e-40ca-83f5-a48e8daeeaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.119651 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54e4d-a71e-40ca-83f5-a48e8daeeaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.119936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54e4d-a71e-40ca-83f5-a48e8daeeaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.120211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54e4d-a71e-40ca-83f5-a48e8daeeaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.120892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa54e4d-a71e-40ca-83f5-a48e8daeeaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.122839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa54e4d-a71e-40ca-83f5-a48e8daeeaa9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.152548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 921/1857] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:08 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:08.153755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee181c-f609-4087-86a7-8d94c87d80a1 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.163602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee181c-f609-4087-86a7-8d94c87d80a1 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.244280 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9633cd0-a9af-438b-96b3-9b555a4dc9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.245245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9633cd0-a9af-438b-96b3-9b555a4dc9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.245543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9633cd0-a9af-438b-96b3-9b555a4dc9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.245848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9633cd0-a9af-438b-96b3-9b555a4dc9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.246820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9633cd0-a9af-438b-96b3-9b555a4dc9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.249705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9633cd0-a9af-438b-96b3-9b555a4dc9f8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.295168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 937/1858] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:08 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:08.296737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54e4d-a71e-40ca-83f5-a48e8daeeaa9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.310500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54e4d-a71e-40ca-83f5-a48e8daeeaa9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.317283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2685dd9-268f-426b-988f-46d5da108560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.318103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2685dd9-268f-426b-988f-46d5da108560 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.318409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2685dd9-268f-426b-988f-46d5da108560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.318793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2685dd9-268f-426b-988f-46d5da108560 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.319744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2685dd9-268f-426b-988f-46d5da108560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.321980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2685dd9-268f-426b-988f-46d5da108560 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.336260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 922/1859] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:08.341008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9633cd0-a9af-438b-96b3-9b555a4dc9f8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.354144 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9633cd0-a9af-438b-96b3-9b555a4dc9f8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.359724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaca274-e304-46ad-985e-9b7ab733e4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.360462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaca274-e304-46ad-985e-9b7ab733e4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.360810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaca274-e304-46ad-985e-9b7ab733e4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.361147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaca274-e304-46ad-985e-9b7ab733e4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.361983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaca274-e304-46ad-985e-9b7ab733e4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.364020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaca274-e304-46ad-985e-9b7ab733e4e7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.378060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 938/1860] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:08.383061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2685dd9-268f-426b-988f-46d5da108560 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.395939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2685dd9-268f-426b-988f-46d5da108560 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.402332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b544-7142-4d87-90fe-d86345654dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.404129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b544-7142-4d87-90fe-d86345654dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.404603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b544-7142-4d87-90fe-d86345654dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.404965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b544-7142-4d87-90fe-d86345654dc0 admin admin] PATH_INFO: `/v3/projects/72d1c06343824ce7850733b1550a0713/users/69bdb14570124ca690b8407d3a50f927/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.425098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b544-7142-4d87-90fe-d86345654dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d1c06343824ce7850733b1550a0713, user_id=69bdb14570124ca690b8407d3a50f927, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.428882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b544-7142-4d87-90fe-d86345654dc0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.452227 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaca274-e304-46ad-985e-9b7ab733e4e7 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.454012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-eeaca274-e304-46ad-985e-9b7ab733e4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:08.463675 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 923/1861] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:08 2022] PUT /identity/v3/projects/72d1c06343824ce7850733b1550a0713/users/69bdb14570124ca690b8407d3a50f927/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:08.468925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaca274-e304-46ad-985e-9b7ab733e4e7 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.474350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d2a4b-b02f-490c-96d8-36c9ccd8c5e7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.474637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d2a4b-b02f-490c-96d8-36c9ccd8c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.474913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d2a4b-b02f-490c-96d8-36c9ccd8c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.523607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-560d2a4b-b02f-490c-96d8-36c9ccd8c5e7 None None] MFA Rules not processed for user `69bdb14570124ca690b8407d3a50f927`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:08.524994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-560d2a4b-b02f-490c-96d8-36c9ccd8c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:08.553511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.554999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.555485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.555770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] PATH_INFO: `/v3/users/c25ed6b1340745509b2d6fa72f152192` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.557150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25ed6b1340745509b2d6fa72f152192)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.559674 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.625562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25ed6b1340745509b2d6fa72f152192'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:08.626308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25ed6b1340745509b2d6fa72f152192'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:08.642903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25ed6b1340745509b2d6fa72f152192'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:08.643608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25ed6b1340745509b2d6fa72f152192'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:08.655028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-48e0354a-d72f-4306-8137-505f14e8205a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25ed6b1340745509b2d6fa72f152192'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:08.661682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 924/1862] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:08.667263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d2a4b-b02f-490c-96d8-36c9ccd8c5e7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.674443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 939/1863] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:08 2022] DELETE /identity/v3/users/c25ed6b1340745509b2d6fa72f152192 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:08.676957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12c6d3-849b-40ff-92fc-8526848909d0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.677428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12c6d3-849b-40ff-92fc-8526848909d0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.677987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12c6d3-849b-40ff-92fc-8526848909d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.680526 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d2a4b-b02f-490c-96d8-36c9ccd8c5e7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.698960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-ec12c6d3-849b-40ff-92fc-8526848909d0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:08.702823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ec12c6d3-849b-40ff-92fc-8526848909d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:08.761315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb541db-c605-408d-adf3-6c6098b037d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.762361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb541db-c605-408d-adf3-6c6098b037d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.762836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb541db-c605-408d-adf3-6c6098b037d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.763310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb541db-c605-408d-adf3-6c6098b037d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.764307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb541db-c605-408d-adf3-6c6098b037d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.769888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb541db-c605-408d-adf3-6c6098b037d5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.789539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 940/1864] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:08.799927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12c6d3-849b-40ff-92fc-8526848909d0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.803139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 925/1865] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:08 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:08.806858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ec12c6d3-849b-40ff-92fc-8526848909d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:08.808973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb541db-c605-408d-adf3-6c6098b037d5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.811289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-abb541db-c605-408d-adf3-6c6098b037d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:08.893705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12c6d3-849b-40ff-92fc-8526848909d0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.916592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb541db-c605-408d-adf3-6c6098b037d5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:08.922657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075d24-e041-40b6-b558-ac1fd7ffe1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.923456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075d24-e041-40b6-b558-ac1fd7ffe1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.923744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075d24-e041-40b6-b558-ac1fd7ffe1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.924227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075d24-e041-40b6-b558-ac1fd7ffe1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.925170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62075d24-e041-40b6-b558-ac1fd7ffe1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.928074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62075d24-e041-40b6-b558-ac1fd7ffe1d1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.951147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b8db-e7fa-4a43-9e2f-ac8c9ff7cd38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:08.952063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b8db-e7fa-4a43-9e2f-ac8c9ff7cd38 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:08.952494 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b8db-e7fa-4a43-9e2f-ac8c9ff7cd38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:08.953252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b8db-e7fa-4a43-9e2f-ac8c9ff7cd38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:08.964815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 926/1866] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:08 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:08.971729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075d24-e041-40b6-b558-ac1fd7ffe1d1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:08.975277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90b8db-e7fa-4a43-9e2f-ac8c9ff7cd38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:08.989827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90b8db-e7fa-4a43-9e2f-ac8c9ff7cd38 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:08.994130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075d24-e041-40b6-b558-ac1fd7ffe1d1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:09.008057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 941/1867] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:00:09.011933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cbcc8-3857-4a85-9f52-89c4b74441c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:09.012609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cbcc8-3857-4a85-9f52-89c4b74441c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.012875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cbcc8-3857-4a85-9f52-89c4b74441c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.013155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cbcc8-3857-4a85-9f52-89c4b74441c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:09.014091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cbcc8-3857-4a85-9f52-89c4b74441c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:09.015620 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cbcc8-3857-4a85-9f52-89c4b74441c1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:09.049885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 927/1868] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:09.050569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b8db-e7fa-4a43-9e2f-ac8c9ff7cd38 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:09.065701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b8db-e7fa-4a43-9e2f-ac8c9ff7cd38 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:09.085347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284368c-9161-47d2-92fe-6c4923b5514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:09.086293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284368c-9161-47d2-92fe-6c4923b5514c admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.086570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284368c-9161-47d2-92fe-6c4923b5514c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.086843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284368c-9161-47d2-92fe-6c4923b5514c admin admin] PATH_INFO: `/v3/projects/ccaf9a26d5774e3d85f8a24bae620b45/users/9c822927335f4113a2017f36bd298300/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:09.115025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284368c-9161-47d2-92fe-6c4923b5514c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaf9a26d5774e3d85f8a24bae620b45, user_id=9c822927335f4113a2017f36bd298300, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:09.118702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284368c-9161-47d2-92fe-6c4923b5514c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:09.154053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 942/1869] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:09 2022] PUT /identity/v3/projects/ccaf9a26d5774e3d85f8a24bae620b45/users/9c822927335f4113a2017f36bd298300/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:09.154410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cbcc8-3857-4a85-9f52-89c4b74441c1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:09.167239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cbcc8-3857-4a85-9f52-89c4b74441c1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:09.283568 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c479417-fa4f-4882-a1a8-10c6876e8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:09.284453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c479417-fa4f-4882-a1a8-10c6876e8939 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.284744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c479417-fa4f-4882-a1a8-10c6876e8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.285836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c479417-fa4f-4882-a1a8-10c6876e8939 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:09.287996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c479417-fa4f-4882-a1a8-10c6876e8939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:09.296316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c479417-fa4f-4882-a1a8-10c6876e8939 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:09.313380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 928/1870] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:09.315201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284368c-9161-47d2-92fe-6c4923b5514c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:09.333054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284368c-9161-47d2-92fe-6c4923b5514c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:09.339761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950208d-d3f6-432d-b5f9-f566540b7bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:09.340960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950208d-d3f6-432d-b5f9-f566540b7bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.341331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950208d-d3f6-432d-b5f9-f566540b7bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.341945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950208d-d3f6-432d-b5f9-f566540b7bb6 admin admin] PATH_INFO: `/v3/projects/ccaf9a26d5774e3d85f8a24bae620b45/users/9c822927335f4113a2017f36bd298300/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:09.344791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950208d-d3f6-432d-b5f9-f566540b7bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaf9a26d5774e3d85f8a24bae620b45, user_id=9c822927335f4113a2017f36bd298300, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:09.357105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950208d-d3f6-432d-b5f9-f566540b7bb6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:09.363953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 943/1871] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:09 2022] PUT /identity/v3/projects/ccaf9a26d5774e3d85f8a24bae620b45/users/9c822927335f4113a2017f36bd298300/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:09.371826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8021d-5653-4280-a038-2b355a84a8ba None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.372775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8021d-5653-4280-a038-2b355a84a8ba None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.373056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8021d-5653-4280-a038-2b355a84a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:09.435199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a3b8021d-5653-4280-a038-2b355a84a8ba None None] MFA Rules not processed for user `9c822927335f4113a2017f36bd298300`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:09.436527 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a3b8021d-5653-4280-a038-2b355a84a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:09.452485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950208d-d3f6-432d-b5f9-f566540b7bb6 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:09.454511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d950208d-d3f6-432d-b5f9-f566540b7bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:09.516716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 929/1872] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:09.529382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8021d-5653-4280-a038-2b355a84a8ba None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:09.530837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a3b8021d-5653-4280-a038-2b355a84a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:09.539120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950208d-d3f6-432d-b5f9-f566540b7bb6 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:09.552462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:09.553652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.554944 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.555360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] PATH_INFO: `/v3/projects/12d50950ebc04aa99f4189812a1e9aa0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:09.557769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d50950ebc04aa99f4189812a1e9aa0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:09.559709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:09.624122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8021d-5653-4280-a038-2b355a84a8ba None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:09.633307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d50950ebc04aa99f4189812a1e9aa0', 'request_id': 'req-2694a9ba-7f73-45c7-9681-d30d348b6bcd'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.642658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d50950ebc04aa99f4189812a1e9aa0', 'request_id': 'req-2694a9ba-7f73-45c7-9681-d30d348b6bcd'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.649839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d50950ebc04aa99f4189812a1e9aa0', 'request_id': 'req-2694a9ba-7f73-45c7-9681-d30d348b6bcd'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.660880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] The token cache is being invalidate because project 12d50950ebc04aa99f4189812a1e9aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:09.661157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.661943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.663803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 944/1873] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:09 2022] DELETE /identity/v3/projects/12d50950ebc04aa99f4189812a1e9aa0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:09.667465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:09.668756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:09.685851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:09.686508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.687128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.687128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:09.688974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:09.759290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:09.761167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:09.764917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694a9ba-7f73-45c7-9681-d30d348b6bcd admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:09.770742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:09.772017 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.772299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.772584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] PATH_INFO: `/v3/users/25e70efe31524723afd644bab5bb306a` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:09.774035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e70efe31524723afd644bab5bb306a)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:09.774141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 930/1874] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:09.776726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:09.828571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e70efe31524723afd644bab5bb306a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.829244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e70efe31524723afd644bab5bb306a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.838849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:09.840550 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:09.844040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e70efe31524723afd644bab5bb306a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.844809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e70efe31524723afd644bab5bb306a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.853235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-130d282e-7292-4264-b84f-c16215691b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e70efe31524723afd644bab5bb306a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.854759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb00028-bce1-448d-acb8-8e3556a73d90 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:09.860138 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:09.860686 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.860970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.861291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] PATH_INFO: `/v3/users/69bdb14570124ca690b8407d3a50f927` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:09.862563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bdb14570124ca690b8407d3a50f927)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:09.864589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:09.868345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 945/1875] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:09 2022] DELETE /identity/v3/users/25e70efe31524723afd644bab5bb306a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:09.923386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bdb14570124ca690b8407d3a50f927'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.943357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bdb14570124ca690b8407d3a50f927'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.953506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bdb14570124ca690b8407d3a50f927'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.954309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bdb14570124ca690b8407d3a50f927'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.962684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bdb14570124ca690b8407d3a50f927'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:09.969462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 931/1876] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:09 2022] DELETE /identity/v3/users/69bdb14570124ca690b8407d3a50f927 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:09.976271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f5a18-df93-476f-9a8b-9ae3bf0c442d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:09.976656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f5a18-df93-476f-9a8b-9ae3bf0c442d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:09.977011 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f5a18-df93-476f-9a8b-9ae3bf0c442d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.036606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2e7f5a18-df93-476f-9a8b-9ae3bf0c442d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:10.040083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2e7f5a18-df93-476f-9a8b-9ae3bf0c442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:10.127604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:10.130141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:10.151244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 946/1877] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:10.188033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f5a18-df93-476f-9a8b-9ae3bf0c442d None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:10.195542 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2e7f5a18-df93-476f-9a8b-9ae3bf0c442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:10.218993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedde3c6-8fe1-490a-a1f4-77b5c72df4d3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:10.224742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:10.225266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.225478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.225843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] PATH_INFO: `/v3/users/5534e4d3353d446d9832032fe1f17b2c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.227334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5534e4d3353d446d9832032fe1f17b2c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:10.229394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:10.277076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f5a18-df93-476f-9a8b-9ae3bf0c442d None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:10.283411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f063ac-cfee-4f1f-a541-2bb128b0f0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:10.284079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f063ac-cfee-4f1f-a541-2bb128b0f0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.284347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f063ac-cfee-4f1f-a541-2bb128b0f0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.284618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f063ac-cfee-4f1f-a541-2bb128b0f0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.300087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f063ac-cfee-4f1f-a541-2bb128b0f0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:10.303481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f063ac-cfee-4f1f-a541-2bb128b0f0c5 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:10.320455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 947/1878] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:10.321756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f063ac-cfee-4f1f-a541-2bb128b0f0c5 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:10.323220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c2f063ac-cfee-4f1f-a541-2bb128b0f0c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:10.351679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f063ac-cfee-4f1f-a541-2bb128b0f0c5 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:10.357452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5534e4d3353d446d9832032fe1f17b2c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.367260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:10.370099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.370403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.370678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] PATH_INFO: `/v3/projects/f2a7e47f4fb54ef088b9496d8fc93ff6` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.374667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a7e47f4fb54ef088b9496d8fc93ff6)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:10.379528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:10.390508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5534e4d3353d446d9832032fe1f17b2c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.409565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5534e4d3353d446d9832032fe1f17b2c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.411346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5534e4d3353d446d9832032fe1f17b2c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.427473 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-695468f6-1706-4b0c-b12d-1a5ccc74469f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5534e4d3353d446d9832032fe1f17b2c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.438671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 932/1879] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:10 2022] DELETE /identity/v3/users/5534e4d3353d446d9832032fe1f17b2c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:10.443610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b114e-49de-4aac-a5dd-c977458dd830 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.443899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b114e-49de-4aac-a5dd-c977458dd830 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.445313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b114e-49de-4aac-a5dd-c977458dd830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.488577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a7e47f4fb54ef088b9496d8fc93ff6', 'request_id': 'req-2bdd9507-0828-49a9-afa2-966286f76e5b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.494727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-462b114e-49de-4aac-a5dd-c977458dd830 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:10.496067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-462b114e-49de-4aac-a5dd-c977458dd830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:10.500779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a7e47f4fb54ef088b9496d8fc93ff6', 'request_id': 'req-2bdd9507-0828-49a9-afa2-966286f76e5b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.519998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a7e47f4fb54ef088b9496d8fc93ff6', 'request_id': 'req-2bdd9507-0828-49a9-afa2-966286f76e5b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.555689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] The token cache is being invalidate because project f2a7e47f4fb54ef088b9496d8fc93ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:10.556871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.557807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2bdd9507-0828-49a9-afa2-966286f76e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:10.564077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 948/1880] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:10 2022] DELETE /identity/v3/projects/f2a7e47f4fb54ef088b9496d8fc93ff6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:10.569977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7899e17-5448-4002-9532-e61bb41d921e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.570364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7899e17-5448-4002-9532-e61bb41d921e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.570739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7899e17-5448-4002-9532-e61bb41d921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.594325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b7899e17-5448-4002-9532-e61bb41d921e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:10.596067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b7899e17-5448-4002-9532-e61bb41d921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:10.684566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 949/1881] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:10.693181 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed80a1d-25c9-4353-8e8a-d33cd188514a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.693658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed80a1d-25c9-4353-8e8a-d33cd188514a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.694005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed80a1d-25c9-4353-8e8a-d33cd188514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.714448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 933/1882] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:10.723812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-bed80a1d-25c9-4353-8e8a-d33cd188514a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:10.725196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bed80a1d-25c9-4353-8e8a-d33cd188514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:10.734448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 950/1883] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:10.738512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b114e-49de-4aac-a5dd-c977458dd830 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:10.745787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed80a1d-25c9-4353-8e8a-d33cd188514a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:10.748717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bed80a1d-25c9-4353-8e8a-d33cd188514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:10.752014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b114e-49de-4aac-a5dd-c977458dd830 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:10.765269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7f444-d3ce-49d4-9a18-a9157a9b274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:10.767345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7f444-d3ce-49d4-9a18-a9157a9b274e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.767851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7f444-d3ce-49d4-9a18-a9157a9b274e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.767979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7f444-d3ce-49d4-9a18-a9157a9b274e admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.768684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7f444-d3ce-49d4-9a18-a9157a9b274e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:10.772977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7f444-d3ce-49d4-9a18-a9157a9b274e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:10.774390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7f444-d3ce-49d4-9a18-a9157a9b274e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:10.791218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 934/1884] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:00:10.795558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7f444-d3ce-49d4-9a18-a9157a9b274e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:10.809641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7f444-d3ce-49d4-9a18-a9157a9b274e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:10.815193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a2fea-88bc-4a61-b80a-9307e7be3da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:10.815960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a2fea-88bc-4a61-b80a-9307e7be3da0 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.816847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a2fea-88bc-4a61-b80a-9307e7be3da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.817195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a2fea-88bc-4a61-b80a-9307e7be3da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.818001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a2fea-88bc-4a61-b80a-9307e7be3da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:10.820513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a2fea-88bc-4a61-b80a-9307e7be3da0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:10.866119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 935/1885] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:10 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:10.867178 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a2fea-88bc-4a61-b80a-9307e7be3da0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:10.869078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d45a2fea-88bc-4a61-b80a-9307e7be3da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:10.873796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed80a1d-25c9-4353-8e8a-d33cd188514a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:10.938850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9eda1-e212-4f8b-955b-81e008c3e70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:10.939506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9eda1-e212-4f8b-955b-81e008c3e70a service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.939788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9eda1-e212-4f8b-955b-81e008c3e70a service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.940072 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9eda1-e212-4f8b-955b-81e008c3e70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.945729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a2fea-88bc-4a61-b80a-9307e7be3da0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:10.951992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:10.953341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9eda1-e212-4f8b-955b-81e008c3e70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:10.953489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.953888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.954409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] PATH_INFO: `/v3/projects/72d1c06343824ce7850733b1550a0713` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.954913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9eda1-e212-4f8b-955b-81e008c3e70a service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:10.956234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d1c06343824ce7850733b1550a0713)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:10.958253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:10.966564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 951/1886] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:10.967216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9eda1-e212-4f8b-955b-81e008c3e70a service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:10.976493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9eda1-e212-4f8b-955b-81e008c3e70a service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:10.981438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5ec42-b7f6-43c2-a4a4-b31d2942013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:10.982282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5ec42-b7f6-43c2-a4a4-b31d2942013b admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:10.982638 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5ec42-b7f6-43c2-a4a4-b31d2942013b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:10.983103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5ec42-b7f6-43c2-a4a4-b31d2942013b admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:10.983889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5ec42-b7f6-43c2-a4a4-b31d2942013b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:10.985908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5ec42-b7f6-43c2-a4a4-b31d2942013b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.007209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 952/1887] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:10 2022] POST /identity/v3/users => generated 305 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:11.011210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5ec42-b7f6-43c2-a4a4-b31d2942013b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.016520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d1c06343824ce7850733b1550a0713', 'request_id': 'req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.021862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5ec42-b7f6-43c2-a4a4-b31d2942013b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.025655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d1c06343824ce7850733b1550a0713', 'request_id': 'req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.033975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d1c06343824ce7850733b1550a0713', 'request_id': 'req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.047368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] The token cache is being invalidate because project 72d1c06343824ce7850733b1550a0713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:11.047873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.048635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.051107 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 936/1888] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:10 2022] DELETE /identity/v3/projects/72d1c06343824ce7850733b1550a0713 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:11.054658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.056014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:11.091257 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec75524-7ac9-42d3-bdd2-a4d86df466e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.092468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec75524-7ac9-42d3-bdd2-a4d86df466e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.092821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec75524-7ac9-42d3-bdd2-a4d86df466e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.093171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec75524-7ac9-42d3-bdd2-a4d86df466e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.094038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec75524-7ac9-42d3-bdd2-a4d86df466e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.095700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec75524-7ac9-42d3-bdd2-a4d86df466e1 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.106822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 953/1889] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:11.110389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec75524-7ac9-42d3-bdd2-a4d86df466e1 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.119362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7ec75524-7ac9-42d3-bdd2-a4d86df466e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:11.128337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806d3d-7a66-4a9b-8b58-912ce6fd5a38 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.134510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.135598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.135953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.136381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] PATH_INFO: `/v3/users/9c822927335f4113a2017f36bd298300` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.137713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c822927335f4113a2017f36bd298300)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.139704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.140656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec75524-7ac9-42d3-bdd2-a4d86df466e1 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.146414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5798-e4ae-4e39-a2d2-1e0313307c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.147024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5798-e4ae-4e39-a2d2-1e0313307c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.147301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5798-e4ae-4e39-a2d2-1e0313307c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.147577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5798-e4ae-4e39-a2d2-1e0313307c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.148301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f5798-e4ae-4e39-a2d2-1e0313307c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.150075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f5798-e4ae-4e39-a2d2-1e0313307c16 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.164519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 954/1890] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:11.166371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5798-e4ae-4e39-a2d2-1e0313307c16 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.182787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5798-e4ae-4e39-a2d2-1e0313307c16 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.187821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4efb5-f5f3-484a-bd55-204cd8a423ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.188704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4efb5-f5f3-484a-bd55-204cd8a423ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.188981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4efb5-f5f3-484a-bd55-204cd8a423ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.189258 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4efb5-f5f3-484a-bd55-204cd8a423ff admin admin] PATH_INFO: `/v3/projects/fefbc47ebd6b4c77a081923563893c69/users/9ed05ea4de584b9ca080007cb2a96e57/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.199604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c822927335f4113a2017f36bd298300'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.207343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4efb5-f5f3-484a-bd55-204cd8a423ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefbc47ebd6b4c77a081923563893c69, user_id=9ed05ea4de584b9ca080007cb2a96e57, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.210254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4efb5-f5f3-484a-bd55-204cd8a423ff admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.213119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c822927335f4113a2017f36bd298300'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.220523 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c822927335f4113a2017f36bd298300'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.221352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c822927335f4113a2017f36bd298300'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.230774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c822927335f4113a2017f36bd298300'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.232982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 955/1891] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:11 2022] PUT /identity/v3/projects/fefbc47ebd6b4c77a081923563893c69/users/9ed05ea4de584b9ca080007cb2a96e57/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:11.234470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59af3a-80d8-474c-9aeb-3735c7724920 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.234758 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59af3a-80d8-474c-9aeb-3735c7724920 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.235029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59af3a-80d8-474c-9aeb-3735c7724920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.240329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 937/1892] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:11 2022] DELETE /identity/v3/users/9c822927335f4113a2017f36bd298300 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:11.262706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7b59af3a-80d8-474c-9aeb-3735c7724920 None None] MFA Rules not processed for user `9ed05ea4de584b9ca080007cb2a96e57`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:11.263925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7b59af3a-80d8-474c-9aeb-3735c7724920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:11.329909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.331808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:11.361238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 956/1893] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:11.362295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59af3a-80d8-474c-9aeb-3735c7724920 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.364767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7b59af3a-80d8-474c-9aeb-3735c7724920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:11.427064 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21d4c-de8d-44db-8217-c9706654c622 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.432810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.433849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.434235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.434926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] PATH_INFO: `/v3/projects/588de8c484fa45d5b6385826cc8f2387` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.437103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588de8c484fa45d5b6385826cc8f2387)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.447091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59af3a-80d8-474c-9aeb-3735c7724920 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.448196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.452555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec98df8-ddf2-4d2b-8b1f-f1a0128f49c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.453227 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec98df8-ddf2-4d2b-8b1f-f1a0128f49c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.453675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec98df8-ddf2-4d2b-8b1f-f1a0128f49c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.453956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec98df8-ddf2-4d2b-8b1f-f1a0128f49c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.454653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec98df8-ddf2-4d2b-8b1f-f1a0128f49c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.456599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec98df8-ddf2-4d2b-8b1f-f1a0128f49c7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.502965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 957/1894] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:11 2022] POST /identity/v3/projects => generated 407 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:11.507677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec98df8-ddf2-4d2b-8b1f-f1a0128f49c7 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.522742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588de8c484fa45d5b6385826cc8f2387', 'request_id': 'req-d2fd2668-a49f-4a80-9237-d87b19f771d9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.539379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588de8c484fa45d5b6385826cc8f2387', 'request_id': 'req-d2fd2668-a49f-4a80-9237-d87b19f771d9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.558132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588de8c484fa45d5b6385826cc8f2387', 'request_id': 'req-d2fd2668-a49f-4a80-9237-d87b19f771d9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.583135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] The token cache is being invalidate because project 588de8c484fa45d5b6385826cc8f2387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:11.583437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.584140 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.586116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 938/1895] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:11 2022] DELETE /identity/v3/projects/588de8c484fa45d5b6385826cc8f2387 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:11.589704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.591098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:11.636199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec98df8-ddf2-4d2b-8b1f-f1a0128f49c7 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.641914 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b348f-3160-4bb9-906e-fbd8505ef4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.642642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b348f-3160-4bb9-906e-fbd8505ef4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.642927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b348f-3160-4bb9-906e-fbd8505ef4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.643201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b348f-3160-4bb9-906e-fbd8505ef4a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.643895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b348f-3160-4bb9-906e-fbd8505ef4a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.646556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b348f-3160-4bb9-906e-fbd8505ef4a8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.679414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 958/1896] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:11 2022] POST /identity/v3/users => generated 310 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:11.683164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b348f-3160-4bb9-906e-fbd8505ef4a8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.685699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-983b348f-3160-4bb9-906e-fbd8505ef4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:11.703097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd2668-a49f-4a80-9237-d87b19f771d9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.710041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.710230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b348f-3160-4bb9-906e-fbd8505ef4a8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.711128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.711929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.712275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] PATH_INFO: `/v3/users/e4d332ee73814dc7946d17acf02c09b6` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.713601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d332ee73814dc7946d17acf02c09b6)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.715756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.717515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a68d0-eb8f-40cf-9b54-62eb74955526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.718670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a68d0-eb8f-40cf-9b54-62eb74955526 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.719138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a68d0-eb8f-40cf-9b54-62eb74955526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.719592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a68d0-eb8f-40cf-9b54-62eb74955526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.720583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a68d0-eb8f-40cf-9b54-62eb74955526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.723081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a68d0-eb8f-40cf-9b54-62eb74955526 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.735981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 959/1897] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:11.740026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a68d0-eb8f-40cf-9b54-62eb74955526 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.751116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a68d0-eb8f-40cf-9b54-62eb74955526 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.757313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7646d45-ad5f-4de6-80d6-d4a12f370d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.758516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7646d45-ad5f-4de6-80d6-d4a12f370d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.758994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7646d45-ad5f-4de6-80d6-d4a12f370d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.759346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7646d45-ad5f-4de6-80d6-d4a12f370d12 admin admin] PATH_INFO: `/v3/projects/7fe04ba9061d43109488da272ef75ffe/users/25f837add61645ae8fda006cc24b314e/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.776481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d332ee73814dc7946d17acf02c09b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.786067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7646d45-ad5f-4de6-80d6-d4a12f370d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe04ba9061d43109488da272ef75ffe, user_id=25f837add61645ae8fda006cc24b314e, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.789051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7646d45-ad5f-4de6-80d6-d4a12f370d12 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.808474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d332ee73814dc7946d17acf02c09b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.816169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 960/1898] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:11 2022] PUT /identity/v3/projects/7fe04ba9061d43109488da272ef75ffe/users/25f837add61645ae8fda006cc24b314e/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:11.816887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7646d45-ad5f-4de6-80d6-d4a12f370d12 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.818888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a7646d45-ad5f-4de6-80d6-d4a12f370d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:11.823808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d332ee73814dc7946d17acf02c09b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.824601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d332ee73814dc7946d17acf02c09b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.834953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d332ee73814dc7946d17acf02c09b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:11.842613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 939/1899] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:11 2022] DELETE /identity/v3/users/e4d332ee73814dc7946d17acf02c09b6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:11.845837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:11.846401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:11.927162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f214dcc-6793-47b7-9102-e9c537a746d1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.933637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caebc3-3816-4b37-a9b2-26eacb5c73be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.934354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caebc3-3816-4b37-a9b2-26eacb5c73be admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.934647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caebc3-3816-4b37-a9b2-26eacb5c73be admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.935026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caebc3-3816-4b37-a9b2-26eacb5c73be admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.935766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caebc3-3816-4b37-a9b2-26eacb5c73be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.937639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caebc3-3816-4b37-a9b2-26eacb5c73be admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.958109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7646d45-ad5f-4de6-80d6-d4a12f370d12 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:11.963478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:11.964342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:11.964831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:11.965024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] PATH_INFO: `/v3/projects/ccaf9a26d5774e3d85f8a24bae620b45` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:11.969629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccaf9a26d5774e3d85f8a24bae620b45)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:11.969629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:11.976444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 940/1900] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:11.977869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caebc3-3816-4b37-a9b2-26eacb5c73be admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.010412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caebc3-3816-4b37-a9b2-26eacb5c73be admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.018163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff82bb2-2f65-449e-9e1e-25430de369e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.019576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff82bb2-2f65-449e-9e1e-25430de369e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.020410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff82bb2-2f65-449e-9e1e-25430de369e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.020691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff82bb2-2f65-449e-9e1e-25430de369e4 admin admin] PATH_INFO: `/v3/projects/7fe04ba9061d43109488da272ef75ffe/users/25f837add61645ae8fda006cc24b314e/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.024803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff82bb2-2f65-449e-9e1e-25430de369e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe04ba9061d43109488da272ef75ffe, user_id=25f837add61645ae8fda006cc24b314e, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.029300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff82bb2-2f65-449e-9e1e-25430de369e4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.047860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccaf9a26d5774e3d85f8a24bae620b45', 'request_id': 'req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.048738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 941/1901] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:11 2022] PUT /identity/v3/projects/7fe04ba9061d43109488da272ef75ffe/users/25f837add61645ae8fda006cc24b314e/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:12.059575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08409a-227a-4341-9b19-60af008f4a16 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.061253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08409a-227a-4341-9b19-60af008f4a16 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.061253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08409a-227a-4341-9b19-60af008f4a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.070337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccaf9a26d5774e3d85f8a24bae620b45', 'request_id': 'req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.081035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccaf9a26d5774e3d85f8a24bae620b45', 'request_id': 'req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.103929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] The token cache is being invalidate because project ccaf9a26d5774e3d85f8a24bae620b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:12.111667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.112546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5ebcdd4-09dd-4463-882d-6f5c18b25ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.114489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 961/1902] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:11 2022] DELETE /identity/v3/projects/ccaf9a26d5774e3d85f8a24bae620b45 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:12.116505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ea08409a-227a-4341-9b19-60af008f4a16 None None] MFA Rules not processed for user `25f837add61645ae8fda006cc24b314e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:12.117849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ea08409a-227a-4341-9b19-60af008f4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.119998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d933ca-27ca-4bea-9420-2d4ef5ff06b0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.120400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d933ca-27ca-4bea-9420-2d4ef5ff06b0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.121434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d933ca-27ca-4bea-9420-2d4ef5ff06b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.157705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-75d933ca-27ca-4bea-9420-2d4ef5ff06b0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:12.159285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-75d933ca-27ca-4bea-9420-2d4ef5ff06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.249722 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 962/1903] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:12.257086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 942/1904] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:12 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:12.261773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276ad81-81ed-4d6f-a1f7-ab3e845f705b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.263746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276ad81-81ed-4d6f-a1f7-ab3e845f705b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.263991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276ad81-81ed-4d6f-a1f7-ab3e845f705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.279790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08409a-227a-4341-9b19-60af008f4a16 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.283823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ea08409a-227a-4341-9b19-60af008f4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.322302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2276ad81-81ed-4d6f-a1f7-ab3e845f705b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:12.323692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2276ad81-81ed-4d6f-a1f7-ab3e845f705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.338764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 963/1905] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:12.339056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276ad81-81ed-4d6f-a1f7-ab3e845f705b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.341199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2276ad81-81ed-4d6f-a1f7-ab3e845f705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.356411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276ad81-81ed-4d6f-a1f7-ab3e845f705b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.361563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.362101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.362346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.362620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] PATH_INFO: `/v3/projects/005a1be36a7f4c7297be299ada212be7` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.364299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005a1be36a7f4c7297be299ada212be7)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.365845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.380081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08409a-227a-4341-9b19-60af008f4a16 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.385519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e4031-4148-47e2-aaf2-cfe88a2fae7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.387016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4031-4148-47e2-aaf2-cfe88a2fae7c service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.387356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4031-4148-47e2-aaf2-cfe88a2fae7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.387638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4031-4148-47e2-aaf2-cfe88a2fae7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.400894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e4031-4148-47e2-aaf2-cfe88a2fae7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.402871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e4031-4148-47e2-aaf2-cfe88a2fae7c service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.413856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 943/1906] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:12 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:00:12.414752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e4031-4148-47e2-aaf2-cfe88a2fae7c service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.414866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005a1be36a7f4c7297be299ada212be7', 'request_id': 'req-fbc17058-6494-43b4-9820-53475297ad47'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.425973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005a1be36a7f4c7297be299ada212be7', 'request_id': 'req-fbc17058-6494-43b4-9820-53475297ad47'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.431726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e4031-4148-47e2-aaf2-cfe88a2fae7c service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.436167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005a1be36a7f4c7297be299ada212be7', 'request_id': 'req-fbc17058-6494-43b4-9820-53475297ad47'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.476438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] The token cache is being invalidate because project 005a1be36a7f4c7297be299ada212be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:12.476731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.477417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fbc17058-6494-43b4-9820-53475297ad47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:12.482424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 964/1907] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:12 2022] DELETE /identity/v3/projects/005a1be36a7f4c7297be299ada212be7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:12.484366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa89a-5178-472a-b7b8-468dc090ba28 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.484656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa89a-5178-472a-b7b8-468dc090ba28 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.484935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa89a-5178-472a-b7b8-468dc090ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.515822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-515aa89a-5178-472a-b7b8-468dc090ba28 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:12.517121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-515aa89a-5178-472a-b7b8-468dc090ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.522395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.524282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.524282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.524282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.524928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:12.525372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.528147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.538956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 965/1908] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:12.541003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f8c3-fa05-4841-91da-1fa4dc89e046 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.541776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f8c3-fa05-4841-91da-1fa4dc89e046 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.542533 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f8c3-fa05-4841-91da-1fa4dc89e046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.546506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 944/1909] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:12.549430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.560391 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.575598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-3a63f8c3-fa05-4841-91da-1fa4dc89e046 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:12.577348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3a63f8c3-fa05-4841-91da-1fa4dc89e046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.589630 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 966/1910] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:12.597682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63f8c3-fa05-4841-91da-1fa4dc89e046 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.599503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa8106-0531-4924-8ee7-a9731fa5524f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.613848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2bc99-ccd7-42b0-af58-1a7d4795c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.618383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2bc99-ccd7-42b0-af58-1a7d4795c366 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.618679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2bc99-ccd7-42b0-af58-1a7d4795c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.618961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2bc99-ccd7-42b0-af58-1a7d4795c366 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.619671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2bc99-ccd7-42b0-af58-1a7d4795c366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.619851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63f8c3-fa05-4841-91da-1fa4dc89e046 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.625992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f54d3e-945d-49ea-924a-a94def8e25f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.626857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f54d3e-945d-49ea-924a-a94def8e25f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.627187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f54d3e-945d-49ea-924a-a94def8e25f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.627533 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f54d3e-945d-49ea-924a-a94def8e25f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.628320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f54d3e-945d-49ea-924a-a94def8e25f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:12.629235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f54d3e-945d-49ea-924a-a94def8e25f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.631277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f54d3e-945d-49ea-924a-a94def8e25f8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.640518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2bc99-ccd7-42b0-af58-1a7d4795c366 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.648218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 967/1911] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:12.653140 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f54d3e-945d-49ea-924a-a94def8e25f8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.664237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f54d3e-945d-49ea-924a-a94def8e25f8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.670612 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1fced-942a-4ae3-9489-6b9515da920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.672396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1fced-942a-4ae3-9489-6b9515da920d admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.672750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1fced-942a-4ae3-9489-6b9515da920d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.674452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1fced-942a-4ae3-9489-6b9515da920d admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.675788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1fced-942a-4ae3-9489-6b9515da920d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.684203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1fced-942a-4ae3-9489-6b9515da920d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.711301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 945/1912] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:12 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:12.715430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2bc99-ccd7-42b0-af58-1a7d4795c366 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.736498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 968/1913] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:12 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:12.736498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1fced-942a-4ae3-9489-6b9515da920d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.738512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b9c1fced-942a-4ae3-9489-6b9515da920d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.816105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2bc99-ccd7-42b0-af58-1a7d4795c366 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.819769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1fced-942a-4ae3-9489-6b9515da920d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.823979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11149b95-e5b9-48a2-a2ef-bdda4aaff51b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.824763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149b95-e5b9-48a2-a2ef-bdda4aaff51b service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.825150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149b95-e5b9-48a2-a2ef-bdda4aaff51b service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.825695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149b95-e5b9-48a2-a2ef-bdda4aaff51b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.827736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-11149b95-e5b9-48a2-a2ef-bdda4aaff51b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:12.899218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe0e72-03ee-428c-9844-6864d0765af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.900340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe0e72-03ee-428c-9844-6864d0765af1 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.900633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe0e72-03ee-428c-9844-6864d0765af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.900912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe0e72-03ee-428c-9844-6864d0765af1 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.901826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe0e72-03ee-428c-9844-6864d0765af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.903635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11149b95-e5b9-48a2-a2ef-bdda4aaff51b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.903860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe0e72-03ee-428c-9844-6864d0765af1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.905227 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11149b95-e5b9-48a2-a2ef-bdda4aaff51b service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.916690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 969/1914] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:12 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:12.917642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11149b95-e5b9-48a2-a2ef-bdda4aaff51b service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.929947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11149b95-e5b9-48a2-a2ef-bdda4aaff51b service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.937165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173689f-d1ef-45c1-89ce-8e9b25cfebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.938220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173689f-d1ef-45c1-89ce-8e9b25cfebb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.938795 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173689f-d1ef-45c1-89ce-8e9b25cfebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.939457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173689f-d1ef-45c1-89ce-8e9b25cfebb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:12.940484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173689f-d1ef-45c1-89ce-8e9b25cfebb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:12.944083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173689f-d1ef-45c1-89ce-8e9b25cfebb8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:12.954072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 946/1915] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:12 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:12.958656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe0e72-03ee-428c-9844-6864d0765af1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.980608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 970/1916] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:12 2022] POST /identity/v3/users => generated 289 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:12.983013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173689f-d1ef-45c1-89ce-8e9b25cfebb8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:12.984769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe0e72-03ee-428c-9844-6864d0765af1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:12.996695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233c1ba-c5f6-4491-8f8c-ea4c62dd9228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:12.999060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233c1ba-c5f6-4491-8f8c-ea4c62dd9228 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:12.999360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233c1ba-c5f6-4491-8f8c-ea4c62dd9228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:12.999648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233c1ba-c5f6-4491-8f8c-ea4c62dd9228 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.000450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233c1ba-c5f6-4491-8f8c-ea4c62dd9228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.005353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233c1ba-c5f6-4491-8f8c-ea4c62dd9228 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.011259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173689f-d1ef-45c1-89ce-8e9b25cfebb8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.024044 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e011dc7-482d-4034-bafa-c04ac1c99d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.026149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e011dc7-482d-4034-bafa-c04ac1c99d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.027574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e011dc7-482d-4034-bafa-c04ac1c99d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.027784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e011dc7-482d-4034-bafa-c04ac1c99d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.030897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e011dc7-482d-4034-bafa-c04ac1c99d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.032712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e011dc7-482d-4034-bafa-c04ac1c99d37 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.034139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 947/1917] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:13.037546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233c1ba-c5f6-4491-8f8c-ea4c62dd9228 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.056092 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 971/1918] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:13.060759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e011dc7-482d-4034-bafa-c04ac1c99d37 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.061266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233c1ba-c5f6-4491-8f8c-ea4c62dd9228 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.069869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c36a8-9a27-4271-a3e5-c4504de49ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.070687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c36a8-9a27-4271-a3e5-c4504de49ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.071499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c36a8-9a27-4271-a3e5-c4504de49ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.071835 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c36a8-9a27-4271-a3e5-c4504de49ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.073173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c36a8-9a27-4271-a3e5-c4504de49ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.076646 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e011dc7-482d-4034-bafa-c04ac1c99d37 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.077927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c36a8-9a27-4271-a3e5-c4504de49ccc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.082985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b73e9b-9b4e-45e1-abfd-4b42e0d802d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.084021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b73e9b-9b4e-45e1-abfd-4b42e0d802d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.084445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b73e9b-9b4e-45e1-abfd-4b42e0d802d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.084871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b73e9b-9b4e-45e1-abfd-4b42e0d802d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.085925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b73e9b-9b4e-45e1-abfd-4b42e0d802d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.088042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b73e9b-9b4e-45e1-abfd-4b42e0d802d8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.101589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 972/1919] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:13.104759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 948/1920] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:13.106089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b73e9b-9b4e-45e1-abfd-4b42e0d802d8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.108593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c36a8-9a27-4271-a3e5-c4504de49ccc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.119220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b73e9b-9b4e-45e1-abfd-4b42e0d802d8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.133942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c36a8-9a27-4271-a3e5-c4504de49ccc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.140840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81965dd5-78f6-4f36-bccf-8bbf575ed04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.142750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81965dd5-78f6-4f36-bccf-8bbf575ed04c admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.145032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81965dd5-78f6-4f36-bccf-8bbf575ed04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.145417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81965dd5-78f6-4f36-bccf-8bbf575ed04c admin admin] PATH_INFO: `/v3/projects/c5d01400df034226b9701a604d562004/users/ae78daa708404c3cabf000c12f35dfc1/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.149870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f408cd-bb72-4a99-9099-e71c2a7634dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.150780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f408cd-bb72-4a99-9099-e71c2a7634dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.151063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f408cd-bb72-4a99-9099-e71c2a7634dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.151315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f408cd-bb72-4a99-9099-e71c2a7634dd admin admin] PATH_INFO: `/v3/projects/6563260413774ecb90915d8cb2c4e798/users/529bc2e65e4a4dacbed38af0d5b46d03/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.178871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f408cd-bb72-4a99-9099-e71c2a7634dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6563260413774ecb90915d8cb2c4e798, user_id=529bc2e65e4a4dacbed38af0d5b46d03, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.179559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81965dd5-78f6-4f36-bccf-8bbf575ed04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d01400df034226b9701a604d562004, user_id=ae78daa708404c3cabf000c12f35dfc1, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.181189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f408cd-bb72-4a99-9099-e71c2a7634dd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.183812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81965dd5-78f6-4f36-bccf-8bbf575ed04c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.199143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 949/1921] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:13 2022] PUT /identity/v3/projects/6563260413774ecb90915d8cb2c4e798/users/529bc2e65e4a4dacbed38af0d5b46d03/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:13.207880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 973/1922] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:13 2022] PUT /identity/v3/projects/c5d01400df034226b9701a604d562004/users/ae78daa708404c3cabf000c12f35dfc1/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:13.211993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16af2e-57f3-4f80-bbb2-172e5240b84e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.212378 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16af2e-57f3-4f80-bbb2-172e5240b84e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.212674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16af2e-57f3-4f80-bbb2-172e5240b84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.224062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e0f9-e617-45a0-a144-49259a2cc292 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.224433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e0f9-e617-45a0-a144-49259a2cc292 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.224737 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e0f9-e617-45a0-a144-49259a2cc292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.258425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-dc16af2e-57f3-4f80-bbb2-172e5240b84e None None] MFA Rules not processed for user `529bc2e65e4a4dacbed38af0d5b46d03`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:13.259796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dc16af2e-57f3-4f80-bbb2-172e5240b84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:13.276703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-10a8e0f9-e617-45a0-a144-49259a2cc292 None None] MFA Rules not processed for user `ae78daa708404c3cabf000c12f35dfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:13.279696 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-10a8e0f9-e617-45a0-a144-49259a2cc292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:13.386928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 950/1923] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:13.395911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16af2e-57f3-4f80-bbb2-172e5240b84e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.409377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 974/1924] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:13.413461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8e0f9-e617-45a0-a144-49259a2cc292 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.475379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16af2e-57f3-4f80-bbb2-172e5240b84e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.482040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25b767-5d7a-4597-98b9-be13afc0954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.482788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b767-5d7a-4597-98b9-be13afc0954e admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.483150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b767-5d7a-4597-98b9-be13afc0954e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.483503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b767-5d7a-4597-98b9-be13afc0954e admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.484276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25b767-5d7a-4597-98b9-be13afc0954e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.486294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25b767-5d7a-4597-98b9-be13afc0954e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.502081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8e0f9-e617-45a0-a144-49259a2cc292 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.508253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e56bd9-5364-4047-83da-d69a7dd968fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.508962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e56bd9-5364-4047-83da-d69a7dd968fb admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.510509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e56bd9-5364-4047-83da-d69a7dd968fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.510509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e56bd9-5364-4047-83da-d69a7dd968fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.510927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e56bd9-5364-4047-83da-d69a7dd968fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.512840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e56bd9-5364-4047-83da-d69a7dd968fb admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.517699 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 951/1925] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:13 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:13.520636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25b767-5d7a-4597-98b9-be13afc0954e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.549294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 975/1926] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:13 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:13.554171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e56bd9-5364-4047-83da-d69a7dd968fb admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.591543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25b767-5d7a-4597-98b9-be13afc0954e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.633761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e56bd9-5364-4047-83da-d69a7dd968fb admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.649982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35593b-3915-492e-b13e-95f06e313ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.653000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2d1e-3aef-43d6-bced-e0306e68151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.653234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35593b-3915-492e-b13e-95f06e313ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.653698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35593b-3915-492e-b13e-95f06e313ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.653810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2d1e-3aef-43d6-bced-e0306e68151b admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.653982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2d1e-3aef-43d6-bced-e0306e68151b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.654260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2d1e-3aef-43d6-bced-e0306e68151b admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.654654 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35593b-3915-492e-b13e-95f06e313ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.654950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2d1e-3aef-43d6-bced-e0306e68151b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.655858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35593b-3915-492e-b13e-95f06e313ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.656869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2d1e-3aef-43d6-bced-e0306e68151b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.658455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35593b-3915-492e-b13e-95f06e313ef8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.687764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 976/1927] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:13 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:13.688485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 952/1928] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:13 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:13.692920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35593b-3915-492e-b13e-95f06e313ef8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.694225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2d1e-3aef-43d6-bced-e0306e68151b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.705659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35593b-3915-492e-b13e-95f06e313ef8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.707140 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2d1e-3aef-43d6-bced-e0306e68151b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.711545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692fce6-dffe-4c84-af10-e4841b904e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.712313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692fce6-dffe-4c84-af10-e4841b904e6c admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.712427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e6c2d-9ccf-4ecc-b0fe-5a2fcfb027bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.712642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692fce6-dffe-4c84-af10-e4841b904e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.712859 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692fce6-dffe-4c84-af10-e4841b904e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.713148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e6c2d-9ccf-4ecc-b0fe-5a2fcfb027bc admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.713607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692fce6-dffe-4c84-af10-e4841b904e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.713783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e6c2d-9ccf-4ecc-b0fe-5a2fcfb027bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.714033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e6c2d-9ccf-4ecc-b0fe-5a2fcfb027bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.715217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692fce6-dffe-4c84-af10-e4841b904e6c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.715340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e6c2d-9ccf-4ecc-b0fe-5a2fcfb027bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.716856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e6c2d-9ccf-4ecc-b0fe-5a2fcfb027bc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.727517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 977/1929] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:13.728312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 953/1930] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:13.734472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692fce6-dffe-4c84-af10-e4841b904e6c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.734623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e6c2d-9ccf-4ecc-b0fe-5a2fcfb027bc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.745628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e6c2d-9ccf-4ecc-b0fe-5a2fcfb027bc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.747716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692fce6-dffe-4c84-af10-e4841b904e6c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.750620 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674258-142f-4a4d-87bd-802bd2363dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.751514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674258-142f-4a4d-87bd-802bd2363dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.751842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674258-142f-4a4d-87bd-802bd2363dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.752120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674258-142f-4a4d-87bd-802bd2363dc2 admin admin] PATH_INFO: `/v3/projects/070c0aaccdde4974a58b6f7e04b18a87/users/e8dd71d924924a9f8c3d3a652e24d32d/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.754870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23ce8d-e063-45b0-9cdf-2a5de2efaf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.755707 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23ce8d-e063-45b0-9cdf-2a5de2efaf9f admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.756088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23ce8d-e063-45b0-9cdf-2a5de2efaf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.756464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23ce8d-e063-45b0-9cdf-2a5de2efaf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.757380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23ce8d-e063-45b0-9cdf-2a5de2efaf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.759262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23ce8d-e063-45b0-9cdf-2a5de2efaf9f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.767937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce674258-142f-4a4d-87bd-802bd2363dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070c0aaccdde4974a58b6f7e04b18a87, user_id=e8dd71d924924a9f8c3d3a652e24d32d, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.771222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce674258-142f-4a4d-87bd-802bd2363dc2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.782063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 978/1931] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:13.783906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23ce8d-e063-45b0-9cdf-2a5de2efaf9f admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.794699 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 954/1932] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:13 2022] PUT /identity/v3/projects/070c0aaccdde4974a58b6f7e04b18a87/users/e8dd71d924924a9f8c3d3a652e24d32d/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:13.798255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674258-142f-4a4d-87bd-802bd2363dc2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.800334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23ce8d-e063-45b0-9cdf-2a5de2efaf9f admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.859585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374226fc-adf4-487f-8742-032db10ae06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.860475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374226fc-adf4-487f-8742-032db10ae06b admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.860656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674258-142f-4a4d-87bd-802bd2363dc2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.860782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374226fc-adf4-487f-8742-032db10ae06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.861010 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374226fc-adf4-487f-8742-032db10ae06b admin admin] PATH_INFO: `/v3/projects/0e5851ef149d420ba8401d3e32331b36/users/70bd66a6aaf444409e291bb0125a61e3/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.869153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c519-4726-447e-9118-36624bbac051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.869927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c519-4726-447e-9118-36624bbac051 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.870208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c519-4726-447e-9118-36624bbac051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.870483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c519-4726-447e-9118-36624bbac051 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.871333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06c519-4726-447e-9118-36624bbac051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.873462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06c519-4726-447e-9118-36624bbac051 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.884603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 955/1933] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:13.886603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374226fc-adf4-487f-8742-032db10ae06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5851ef149d420ba8401d3e32331b36, user_id=70bd66a6aaf444409e291bb0125a61e3, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.888552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c519-4726-447e-9118-36624bbac051 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:13.893987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374226fc-adf4-487f-8742-032db10ae06b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.900105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c519-4726-447e-9118-36624bbac051 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:13.908367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f48d27-cf8d-4e99-9d56-61872ba0eec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:13.911589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f48d27-cf8d-4e99-9d56-61872ba0eec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.912637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f48d27-cf8d-4e99-9d56-61872ba0eec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.913016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f48d27-cf8d-4e99-9d56-61872ba0eec5 admin admin] PATH_INFO: `/v3/projects/070c0aaccdde4974a58b6f7e04b18a87/users/e8dd71d924924a9f8c3d3a652e24d32d/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.917769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f48d27-cf8d-4e99-9d56-61872ba0eec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070c0aaccdde4974a58b6f7e04b18a87, user_id=e8dd71d924924a9f8c3d3a652e24d32d, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:13.921141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 979/1934] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:13 2022] PUT /identity/v3/projects/0e5851ef149d420ba8401d3e32331b36/users/70bd66a6aaf444409e291bb0125a61e3/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:13.922803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f48d27-cf8d-4e99-9d56-61872ba0eec5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:13.932478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b05e9-98ee-48bf-85d0-f233d7332d71 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.932979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b05e9-98ee-48bf-85d0-f233d7332d71 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.933266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b05e9-98ee-48bf-85d0-f233d7332d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.942597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 956/1935] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:13 2022] PUT /identity/v3/projects/070c0aaccdde4974a58b6f7e04b18a87/users/e8dd71d924924a9f8c3d3a652e24d32d/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:13.955006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ffae-ab7f-48b5-8354-64452d7bcb57 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:13.955779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ffae-ab7f-48b5-8354-64452d7bcb57 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:13.956063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ffae-ab7f-48b5-8354-64452d7bcb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:13.968904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4c9b05e9-98ee-48bf-85d0-f233d7332d71 None None] MFA Rules not processed for user `70bd66a6aaf444409e291bb0125a61e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:13.970459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4c9b05e9-98ee-48bf-85d0-f233d7332d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:13.984914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-30a2ffae-ab7f-48b5-8354-64452d7bcb57 None None] MFA Rules not processed for user `e8dd71d924924a9f8c3d3a652e24d32d`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:13.986307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-30a2ffae-ab7f-48b5-8354-64452d7bcb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:14.063963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 980/1936] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:14.069273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b05e9-98ee-48bf-85d0-f233d7332d71 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:14.077679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 957/1937] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:13 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:14.086543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2ffae-ab7f-48b5-8354-64452d7bcb57 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:14.088506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-30a2ffae-ab7f-48b5-8354-64452d7bcb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:14.182432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b05e9-98ee-48bf-85d0-f233d7332d71 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:14.187849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56db7c-4ab3-42e8-bbf3-ab760223ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:14.189240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56db7c-4ab3-42e8-bbf3-ab760223ef2f admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:14.189692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56db7c-4ab3-42e8-bbf3-ab760223ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:14.190148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56db7c-4ab3-42e8-bbf3-ab760223ef2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:14.192007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56db7c-4ab3-42e8-bbf3-ab760223ef2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:14.193677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2ffae-ab7f-48b5-8354-64452d7bcb57 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:14.194323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56db7c-4ab3-42e8-bbf3-ab760223ef2f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:14.197831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c2f1f-84ad-4981-807d-2d3adb740050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:14.198763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c2f1f-84ad-4981-807d-2d3adb740050 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:14.199484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c2f1f-84ad-4981-807d-2d3adb740050 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:14.199843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c2f1f-84ad-4981-807d-2d3adb740050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:14.213029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c2f1f-84ad-4981-807d-2d3adb740050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:14.214935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c2f1f-84ad-4981-807d-2d3adb740050 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:14.226794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 981/1938] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:14 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:14.227152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 958/1939] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:14.230235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c2f1f-84ad-4981-807d-2d3adb740050 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:14.244373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c2f1f-84ad-4981-807d-2d3adb740050 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:14.333126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e271a-c210-4456-8885-2859da43f712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:14.333847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e271a-c210-4456-8885-2859da43f712 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:14.334135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e271a-c210-4456-8885-2859da43f712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:14.334414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e271a-c210-4456-8885-2859da43f712 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:14.334969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56db7c-4ab3-42e8-bbf3-ab760223ef2f admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:14.335841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e271a-c210-4456-8885-2859da43f712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:14.338069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e271a-c210-4456-8885-2859da43f712 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:14.368443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 959/1940] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:14 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:14.372438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e271a-c210-4456-8885-2859da43f712 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:14.382516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e271a-c210-4456-8885-2859da43f712 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:14.387761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589d33-82d4-46c2-a444-fdb95f936403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:14.388503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589d33-82d4-46c2-a444-fdb95f936403 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:14.388798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589d33-82d4-46c2-a444-fdb95f936403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:14.389066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589d33-82d4-46c2-a444-fdb95f936403 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:14.389839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c589d33-82d4-46c2-a444-fdb95f936403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:14.391509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c589d33-82d4-46c2-a444-fdb95f936403 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:14.404078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 960/1941] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:14.409056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589d33-82d4-46c2-a444-fdb95f936403 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:14.413469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56db7c-4ab3-42e8-bbf3-ab760223ef2f admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:14.418369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd2b31-c0f0-42c5-951b-306c199bf4f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:14.419277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd2b31-c0f0-42c5-951b-306c199bf4f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:14.419712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd2b31-c0f0-42c5-951b-306c199bf4f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:14.420136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd2b31-c0f0-42c5-951b-306c199bf4f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:14.420582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589d33-82d4-46c2-a444-fdb95f936403 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:14.426291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bb9e4-c8c0-4476-8566-0946963b9f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:14.427301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bb9e4-c8c0-4476-8566-0946963b9f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:14.428129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bb9e4-c8c0-4476-8566-0946963b9f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:14.428129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bb9e4-c8c0-4476-8566-0946963b9f9f admin admin] PATH_INFO: `/v3/projects/dee14f213b0348d89f98d7cb54749a7e/users/fd096c642dbb4798854f5ec57494a58e/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:14.444681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bb9e4-c8c0-4476-8566-0946963b9f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee14f213b0348d89f98d7cb54749a7e, user_id=fd096c642dbb4798854f5ec57494a58e, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:14.447557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bb9e4-c8c0-4476-8566-0946963b9f9f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:14.484988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 961/1942] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:14 2022] PUT /identity/v3/projects/dee14f213b0348d89f98d7cb54749a7e/users/fd096c642dbb4798854f5ec57494a58e/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:14.496141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bb9e4-c8c0-4476-8566-0946963b9f9f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:14.532055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd2b31-c0f0-42c5-951b-306c199bf4f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:14.533567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd2b31-c0f0-42c5-951b-306c199bf4f3 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:14.553582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 982/1943] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:00:14.664616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bb9e4-c8c0-4476-8566-0946963b9f9f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:14.688788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4cdf5-0fcb-4c0d-8ef1-746dd34a8f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:14.689863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4cdf5-0fcb-4c0d-8ef1-746dd34a8f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:14.690985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4cdf5-0fcb-4c0d-8ef1-746dd34a8f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:14.691325 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4cdf5-0fcb-4c0d-8ef1-746dd34a8f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:14.694748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4cdf5-0fcb-4c0d-8ef1-746dd34a8f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:14.714301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4cdf5-0fcb-4c0d-8ef1-746dd34a8f01 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:14.731894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 962/1944] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:14.735973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd2b31-c0f0-42c5-951b-306c199bf4f3 service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:14.751797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd2b31-c0f0-42c5-951b-306c199bf4f3 service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:14.764667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9cee4-f0bb-4777-9aaf-6e04d4125a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:14.771786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9cee4-f0bb-4777-9aaf-6e04d4125a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:14.772075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9cee4-f0bb-4777-9aaf-6e04d4125a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:14.772353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9cee4-f0bb-4777-9aaf-6e04d4125a8e admin admin] PATH_INFO: `/v3/projects/dee14f213b0348d89f98d7cb54749a7e/users/fd096c642dbb4798854f5ec57494a58e/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:14.781836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9cee4-f0bb-4777-9aaf-6e04d4125a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee14f213b0348d89f98d7cb54749a7e, user_id=fd096c642dbb4798854f5ec57494a58e, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:14.786750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9cee4-f0bb-4777-9aaf-6e04d4125a8e admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:14.820245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 983/1945] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:14 2022] PUT /identity/v3/projects/dee14f213b0348d89f98d7cb54749a7e/users/fd096c642dbb4798854f5ec57494a58e/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:14.834437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850374bb-9f0d-4037-918d-9790896e85c8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:14.834829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850374bb-9f0d-4037-918d-9790896e85c8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:14.834996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850374bb-9f0d-4037-918d-9790896e85c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:14.876446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-850374bb-9f0d-4037-918d-9790896e85c8 None None] MFA Rules not processed for user `fd096c642dbb4798854f5ec57494a58e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:14.878060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-850374bb-9f0d-4037-918d-9790896e85c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:15.097771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 963/1946] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:15.116598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9cee4-f0bb-4777-9aaf-6e04d4125a8e admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:15.210525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9cee4-f0bb-4777-9aaf-6e04d4125a8e admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:15.216491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa88d7-d6c4-463c-937d-5e7051eaf545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:15.218746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa88d7-d6c4-463c-937d-5e7051eaf545 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:15.218746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa88d7-d6c4-463c-937d-5e7051eaf545 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:15.218746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa88d7-d6c4-463c-937d-5e7051eaf545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:15.290387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa88d7-d6c4-463c-937d-5e7051eaf545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:15.292427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa88d7-d6c4-463c-937d-5e7051eaf545 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:15.302774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 984/1947] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:20.028348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850374bb-9f0d-4037-918d-9790896e85c8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:20.041798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850374bb-9f0d-4037-918d-9790896e85c8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:20.046021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09aac-7cec-4106-a6dd-dda3618a049a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:20.046678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09aac-7cec-4106-a6dd-dda3618a049a service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:20.046962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09aac-7cec-4106-a6dd-dda3618a049a service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:20.047745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09aac-7cec-4106-a6dd-dda3618a049a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:20.104510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09aac-7cec-4106-a6dd-dda3618a049a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:20.109815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09aac-7cec-4106-a6dd-dda3618a049a service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:20.119682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 964/1948] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:20.649924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa88d7-d6c4-463c-937d-5e7051eaf545 service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:20.658327 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa88d7-d6c4-463c-937d-5e7051eaf545 service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:20.663287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaa041-e5dc-4678-9a83-b6127d7a3630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:20.664577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa041-e5dc-4678-9a83-b6127d7a3630 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:20.664751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa041-e5dc-4678-9a83-b6127d7a3630 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:20.665027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa041-e5dc-4678-9a83-b6127d7a3630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:20.680986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acaa041-e5dc-4678-9a83-b6127d7a3630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:20.682466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acaa041-e5dc-4678-9a83-b6127d7a3630 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:20.692789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 985/1949] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:21.684441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09aac-7cec-4106-a6dd-dda3618a049a service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:21.686403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9cd09aac-7cec-4106-a6dd-dda3618a049a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:21.750717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09aac-7cec-4106-a6dd-dda3618a049a service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:21.755692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:21.756554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:21.756829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:21.757097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] PATH_INFO: `/v3/users/9ed05ea4de584b9ca080007cb2a96e57` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:21.758315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed05ea4de584b9ca080007cb2a96e57)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:21.760219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:21.806500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed05ea4de584b9ca080007cb2a96e57'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:21.818498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed05ea4de584b9ca080007cb2a96e57'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:21.825794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed05ea4de584b9ca080007cb2a96e57'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:21.826497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed05ea4de584b9ca080007cb2a96e57'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:21.834436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed05ea4de584b9ca080007cb2a96e57'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:21.840833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 965/1950] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:21 2022] DELETE /identity/v3/users/9ed05ea4de584b9ca080007cb2a96e57 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:21.845447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8f439-2666-4e7c-b2d3-06db4e82aa3f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:21.845962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8f439-2666-4e7c-b2d3-06db4e82aa3f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:21.846158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8f439-2666-4e7c-b2d3-06db4e82aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:21.864410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-20e8f439-2666-4e7c-b2d3-06db4e82aa3f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:21.865649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-20e8f439-2666-4e7c-b2d3-06db4e82aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:21.925733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 986/1951] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:21.935287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:21.936889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:22.001721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76231a0-a5ed-4b20-8ca7-0290d0d485bc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:22.005775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc8bf7-42f2-46d3-8b74-63afc35c8d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:22.006514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc8bf7-42f2-46d3-8b74-63afc35c8d01 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:22.006931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc8bf7-42f2-46d3-8b74-63afc35c8d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:22.007217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc8bf7-42f2-46d3-8b74-63afc35c8d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:22.017267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc8bf7-42f2-46d3-8b74-63afc35c8d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:22.018803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc8bf7-42f2-46d3-8b74-63afc35c8d01 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:22.028534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 966/1952] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:00:22.356719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8f439-2666-4e7c-b2d3-06db4e82aa3f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:22.358377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-20e8f439-2666-4e7c-b2d3-06db4e82aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:22.374246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8f439-2666-4e7c-b2d3-06db4e82aa3f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:22.376432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:22.377336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:22.377876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:22.378153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] PATH_INFO: `/v3/projects/fefbc47ebd6b4c77a081923563893c69` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:22.379386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fefbc47ebd6b4c77a081923563893c69)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:22.382462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:22.432840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fefbc47ebd6b4c77a081923563893c69', 'request_id': 'req-445a6eca-74ce-43c3-ba65-1073ed3c6b42'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.441240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fefbc47ebd6b4c77a081923563893c69', 'request_id': 'req-445a6eca-74ce-43c3-ba65-1073ed3c6b42'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.448658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fefbc47ebd6b4c77a081923563893c69', 'request_id': 'req-445a6eca-74ce-43c3-ba65-1073ed3c6b42'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.467155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] The token cache is being invalidate because project fefbc47ebd6b4c77a081923563893c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:22.467155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.467155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.469607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 987/1953] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:22 2022] DELETE /identity/v3/projects/fefbc47ebd6b4c77a081923563893c69 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:22.473484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc8bf7-42f2-46d3-8b74-63afc35c8d01 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:22.483258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc8bf7-42f2-46d3-8b74-63afc35c8d01 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:22.542250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:22.543127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:22.543410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:22.543685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] PATH_INFO: `/v3/users/25f837add61645ae8fda006cc24b314e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:22.544915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f837add61645ae8fda006cc24b314e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:22.546860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:22.596728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f837add61645ae8fda006cc24b314e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.608414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f837add61645ae8fda006cc24b314e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.614991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f837add61645ae8fda006cc24b314e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.615677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f837add61645ae8fda006cc24b314e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.624229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f837add61645ae8fda006cc24b314e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:22.631889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 967/1954] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:22 2022] DELETE /identity/v3/users/25f837add61645ae8fda006cc24b314e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:22.851811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:22.853124 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:22.867289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a6eca-74ce-43c3-ba65-1073ed3c6b42 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:22.957568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:22.958776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:22.959012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:22.968684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] PATH_INFO: `/v3/users/529bc2e65e4a4dacbed38af0d5b46d03` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:22.970128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=529bc2e65e4a4dacbed38af0d5b46d03)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:22.973320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:23.026318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529bc2e65e4a4dacbed38af0d5b46d03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.027112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529bc2e65e4a4dacbed38af0d5b46d03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.039469 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:23.041573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529bc2e65e4a4dacbed38af0d5b46d03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.042421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529bc2e65e4a4dacbed38af0d5b46d03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.042876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:23.063147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a578ffd4-b0eb-47e3-ab11-d9a0659254fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529bc2e65e4a4dacbed38af0d5b46d03'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.065288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6d77-87c3-48fe-a3fe-877f387be1ba admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:23.071964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:23.074424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.075294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.075863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] PATH_INFO: `/v3/projects/7fe04ba9061d43109488da272ef75ffe` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.076927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 988/1955] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:22 2022] DELETE /identity/v3/users/529bc2e65e4a4dacbed38af0d5b46d03 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:23.077805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe04ba9061d43109488da272ef75ffe)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:23.081289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:23.087051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ecea2-8a91-452b-bd12-487183b48d90 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.087348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ecea2-8a91-452b-bd12-487183b48d90 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.090263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ecea2-8a91-452b-bd12-487183b48d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.135081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-007ecea2-8a91-452b-bd12-487183b48d90 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:23.136878 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-007ecea2-8a91-452b-bd12-487183b48d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:23.145460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe04ba9061d43109488da272ef75ffe', 'request_id': 'req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.159702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe04ba9061d43109488da272ef75ffe', 'request_id': 'req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.168538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe04ba9061d43109488da272ef75ffe', 'request_id': 'req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.188990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] The token cache is being invalidate because project 7fe04ba9061d43109488da272ef75ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:23.189587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.190468 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2f03feb9-4114-4968-ae2a-c9aa2ab19f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:23.194086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 968/1956] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:23 2022] DELETE /identity/v3/projects/7fe04ba9061d43109488da272ef75ffe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:23.199749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5a0ab-b671-487e-aa23-c4a5ed714559 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.200220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5a0ab-b671-487e-aa23-c4a5ed714559 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.200676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5a0ab-b671-487e-aa23-c4a5ed714559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.231446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 989/1957] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:23.234675 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-38b5a0ab-b671-487e-aa23-c4a5ed714559 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:23.235915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-38b5a0ab-b671-487e-aa23-c4a5ed714559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:23.245937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 969/1958] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:23.255967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b4a9-920e-4037-a653-50b0cce64fcc None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.256461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b4a9-920e-4037-a653-50b0cce64fcc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.256900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b4a9-920e-4037-a653-50b0cce64fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.286739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9b48b4a9-920e-4037-a653-50b0cce64fcc None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:23.289877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9b48b4a9-920e-4037-a653-50b0cce64fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:23.299128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 990/1959] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:23.302581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5a0ab-b671-487e-aa23-c4a5ed714559 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:23.303633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-38b5a0ab-b671-487e-aa23-c4a5ed714559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:23.314470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b4a9-920e-4037-a653-50b0cce64fcc None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:23.331355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b4a9-920e-4037-a653-50b0cce64fcc None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:23.336856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce2ac7-7900-440f-a0df-aa744e4c8ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:23.337740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce2ac7-7900-440f-a0df-aa744e4c8ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.338019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce2ac7-7900-440f-a0df-aa744e4c8ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.338287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce2ac7-7900-440f-a0df-aa744e4c8ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.339003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce2ac7-7900-440f-a0df-aa744e4c8ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:23.339301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce2ac7-7900-440f-a0df-aa744e4c8ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:23.342956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce2ac7-7900-440f-a0df-aa744e4c8ef8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:23.371964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 991/1960] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:23.375450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce2ac7-7900-440f-a0df-aa744e4c8ef8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:23.388020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce2ac7-7900-440f-a0df-aa744e4c8ef8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:23.393079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62beb83-ce85-41af-9d2b-42fd5a2ee062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:23.393995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62beb83-ce85-41af-9d2b-42fd5a2ee062 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.395517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62beb83-ce85-41af-9d2b-42fd5a2ee062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.395991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62beb83-ce85-41af-9d2b-42fd5a2ee062 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.397039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62beb83-ce85-41af-9d2b-42fd5a2ee062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:23.398441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5a0ab-b671-487e-aa23-c4a5ed714559 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:23.399830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62beb83-ce85-41af-9d2b-42fd5a2ee062 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:23.403554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe873-1843-438a-aea1-2e6fb5e00ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:23.404288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe873-1843-438a-aea1-2e6fb5e00ffa service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.404679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe873-1843-438a-aea1-2e6fb5e00ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.404939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe873-1843-438a-aea1-2e6fb5e00ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.422462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfe873-1843-438a-aea1-2e6fb5e00ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:23.424381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfe873-1843-438a-aea1-2e6fb5e00ffa service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:23.443190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 992/1961] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:23 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:23.443379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 970/1962] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:23.448112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62beb83-ce85-41af-9d2b-42fd5a2ee062 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:23.521060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62beb83-ce85-41af-9d2b-42fd5a2ee062 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:23.526086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a976b-fe16-4654-b308-d3d02aeae685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:23.526690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a976b-fe16-4654-b308-d3d02aeae685 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.526970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a976b-fe16-4654-b308-d3d02aeae685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.527244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a976b-fe16-4654-b308-d3d02aeae685 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.528078 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a976b-fe16-4654-b308-d3d02aeae685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:23.530338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a976b-fe16-4654-b308-d3d02aeae685 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:23.572039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 993/1963] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:23 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:23.577790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe873-1843-438a-aea1-2e6fb5e00ffa service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:23.605075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe873-1843-438a-aea1-2e6fb5e00ffa service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:23.617629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f108d-0342-47c4-981a-71354a30dd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:23.618312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f108d-0342-47c4-981a-71354a30dd8a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.618604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f108d-0342-47c4-981a-71354a30dd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.619317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f108d-0342-47c4-981a-71354a30dd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.619969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f108d-0342-47c4-981a-71354a30dd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:23.623039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f108d-0342-47c4-981a-71354a30dd8a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:23.649690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 971/1964] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:23.650917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a976b-fe16-4654-b308-d3d02aeae685 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:23.669307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a976b-fe16-4654-b308-d3d02aeae685 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:23.674617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c2a7d-6e3c-4093-a2a6-8ea91c6d1822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:23.675307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c2a7d-6e3c-4093-a2a6-8ea91c6d1822 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.675951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c2a7d-6e3c-4093-a2a6-8ea91c6d1822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.675951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c2a7d-6e3c-4093-a2a6-8ea91c6d1822 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.676623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c2a7d-6e3c-4093-a2a6-8ea91c6d1822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:23.678691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c2a7d-6e3c-4093-a2a6-8ea91c6d1822 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:23.702377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 994/1965] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:23.703154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f108d-0342-47c4-981a-71354a30dd8a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:23.719389 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f108d-0342-47c4-981a-71354a30dd8a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:23.728754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec811-9f33-436d-b634-ec61c336e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:23.730024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec811-9f33-436d-b634-ec61c336e741 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.730155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec811-9f33-436d-b634-ec61c336e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.730431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec811-9f33-436d-b634-ec61c336e741 admin admin] PATH_INFO: `/v3/projects/35f236e24dfe4fd6b7ab30ad44f70b5b/users/9406d28bfbaa4e938e09ca4806fea0b7/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.750522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec811-9f33-436d-b634-ec61c336e741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f236e24dfe4fd6b7ab30ad44f70b5b, user_id=9406d28bfbaa4e938e09ca4806fea0b7, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:23.754119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec811-9f33-436d-b634-ec61c336e741 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:23.773160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 972/1966] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:23 2022] PUT /identity/v3/projects/35f236e24dfe4fd6b7ab30ad44f70b5b/users/9406d28bfbaa4e938e09ca4806fea0b7/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:23.784036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de0c7-5758-41cc-b8e8-469280dbc5cc None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:23.784534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de0c7-5758-41cc-b8e8-469280dbc5cc None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:23.784887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de0c7-5758-41cc-b8e8-469280dbc5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:23.824945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-bc2de0c7-5758-41cc-b8e8-469280dbc5cc None None] MFA Rules not processed for user `9406d28bfbaa4e938e09ca4806fea0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:23.826726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bc2de0c7-5758-41cc-b8e8-469280dbc5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:23.966366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 995/1967] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:23.979124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec811-9f33-436d-b634-ec61c336e741 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:23.981395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9b4ec811-9f33-436d-b634-ec61c336e741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:24.064054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec811-9f33-436d-b634-ec61c336e741 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:24.077168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba6789-f036-4ed6-a5ed-c9721a44cc24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:24.078140 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba6789-f036-4ed6-a5ed-c9721a44cc24 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:24.078688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba6789-f036-4ed6-a5ed-c9721a44cc24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:24.079114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba6789-f036-4ed6-a5ed-c9721a44cc24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:24.090421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba6789-f036-4ed6-a5ed-c9721a44cc24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:24.092034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba6789-f036-4ed6-a5ed-c9721a44cc24 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:24.102271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 973/1968] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:24.124228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de0c7-5758-41cc-b8e8-469280dbc5cc None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:24.211064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de0c7-5758-41cc-b8e8-469280dbc5cc None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:24.224512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:24.226220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:24.226509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:24.226789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] PATH_INFO: `/v3/users/9406d28bfbaa4e938e09ca4806fea0b7` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:24.228367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9406d28bfbaa4e938e09ca4806fea0b7)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:24.230428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:24.296383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9406d28bfbaa4e938e09ca4806fea0b7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.296957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9406d28bfbaa4e938e09ca4806fea0b7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.309723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9406d28bfbaa4e938e09ca4806fea0b7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.310693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9406d28bfbaa4e938e09ca4806fea0b7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.318663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9406d28bfbaa4e938e09ca4806fea0b7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.335398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 996/1969] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:24 2022] DELETE /identity/v3/users/9406d28bfbaa4e938e09ca4806fea0b7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:24.337171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26980763-c05d-49be-bb2b-53218210f3e0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:24.337463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26980763-c05d-49be-bb2b-53218210f3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:24.337761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26980763-c05d-49be-bb2b-53218210f3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:24.358700 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-26980763-c05d-49be-bb2b-53218210f3e0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:24.360044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-26980763-c05d-49be-bb2b-53218210f3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:24.433208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:24.434721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:24.454843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 974/1970] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:24.465508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26980763-c05d-49be-bb2b-53218210f3e0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:24.467128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-26980763-c05d-49be-bb2b-53218210f3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:24.520058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c960232-ba2c-4dda-91f8-f83e73098bcf admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:24.526131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:24.526381 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:24.526710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:24.526987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] PATH_INFO: `/v3/projects/6563260413774ecb90915d8cb2c4e798` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:24.528174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6563260413774ecb90915d8cb2c4e798)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:24.530111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:24.530617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26980763-c05d-49be-bb2b-53218210f3e0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:24.534211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75e773-9890-4a88-b5eb-50791d593d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:24.534918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75e773-9890-4a88-b5eb-50791d593d06 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:24.535200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75e773-9890-4a88-b5eb-50791d593d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:24.535472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75e773-9890-4a88-b5eb-50791d593d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:24.545028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75e773-9890-4a88-b5eb-50791d593d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:24.546482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75e773-9890-4a88-b5eb-50791d593d06 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:24.557144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 975/1971] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:00:24.582856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6563260413774ecb90915d8cb2c4e798', 'request_id': 'req-807f4533-2386-4a8b-9f14-2037f69d279d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.594038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6563260413774ecb90915d8cb2c4e798', 'request_id': 'req-807f4533-2386-4a8b-9f14-2037f69d279d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.603199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6563260413774ecb90915d8cb2c4e798', 'request_id': 'req-807f4533-2386-4a8b-9f14-2037f69d279d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.616093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] The token cache is being invalidate because project 6563260413774ecb90915d8cb2c4e798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:24.616635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.617317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.619411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 997/1972] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:24 2022] DELETE /identity/v3/projects/6563260413774ecb90915d8cb2c4e798 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:24.623113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75e773-9890-4a88-b5eb-50791d593d06 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:24.634509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75e773-9890-4a88-b5eb-50791d593d06 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:24.745478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:24.746625 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:24.746992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:24.747397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] PATH_INFO: `/v3/users/e8dd71d924924a9f8c3d3a652e24d32d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:24.748798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8dd71d924924a9f8c3d3a652e24d32d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:24.750897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:24.779765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:24.781728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:24.798209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f4533-2386-4a8b-9f14-2037f69d279d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:24.805118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:24.806366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:24.806699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:24.807016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] PATH_INFO: `/v3/users/ae78daa708404c3cabf000c12f35dfc1` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:24.808398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae78daa708404c3cabf000c12f35dfc1)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:24.810720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:24.828816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8dd71d924924a9f8c3d3a652e24d32d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.850121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8dd71d924924a9f8c3d3a652e24d32d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.859044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8dd71d924924a9f8c3d3a652e24d32d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.860053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8dd71d924924a9f8c3d3a652e24d32d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.876558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8dd71d924924a9f8c3d3a652e24d32d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.883922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 976/1973] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:24 2022] DELETE /identity/v3/users/e8dd71d924924a9f8c3d3a652e24d32d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:24.885242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:24.887855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:24.916733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae78daa708404c3cabf000c12f35dfc1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.917911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae78daa708404c3cabf000c12f35dfc1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.934001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae78daa708404c3cabf000c12f35dfc1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.935755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae78daa708404c3cabf000c12f35dfc1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.948103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9dea5675-daf8-4142-904b-9af49d9dceb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae78daa708404c3cabf000c12f35dfc1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:24.969214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146a359-2925-4ee0-970a-bc8fe629b063 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:24.971715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 998/1974] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:24 2022] DELETE /identity/v3/users/ae78daa708404c3cabf000c12f35dfc1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:24.976188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dddab-23b9-480e-a56d-990b358ad96c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:24.976683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dddab-23b9-480e-a56d-990b358ad96c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:24.977259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dddab-23b9-480e-a56d-990b358ad96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.001442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-dc2dddab-23b9-480e-a56d-990b358ad96c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:25.003124 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-dc2dddab-23b9-480e-a56d-990b358ad96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:25.049230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.050262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.050786 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.051074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] PATH_INFO: `/v3/projects/35f236e24dfe4fd6b7ab30ad44f70b5b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.052657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f236e24dfe4fd6b7ab30ad44f70b5b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.055367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.114120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 999/1975] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:25.115494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f236e24dfe4fd6b7ab30ad44f70b5b', 'request_id': 'req-6766c072-6bf2-40d2-97f3-6da8e73df316'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.125104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dddab-23b9-480e-a56d-990b358ad96c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.127014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-dc2dddab-23b9-480e-a56d-990b358ad96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:25.129928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f236e24dfe4fd6b7ab30ad44f70b5b', 'request_id': 'req-6766c072-6bf2-40d2-97f3-6da8e73df316'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.136330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f236e24dfe4fd6b7ab30ad44f70b5b', 'request_id': 'req-6766c072-6bf2-40d2-97f3-6da8e73df316'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.149723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] The token cache is being invalidate because project 35f236e24dfe4fd6b7ab30ad44f70b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:25.150139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.150873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6766c072-6bf2-40d2-97f3-6da8e73df316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.152615 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 977/1976] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:24 2022] DELETE /identity/v3/projects/35f236e24dfe4fd6b7ab30ad44f70b5b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:25.157468 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349595fb-6f42-45b5-8ab4-7f0d5e3afd12 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.158570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349595fb-6f42-45b5-8ab4-7f0d5e3afd12 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.158924 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349595fb-6f42-45b5-8ab4-7f0d5e3afd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.186065 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-349595fb-6f42-45b5-8ab4-7f0d5e3afd12 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:25.187295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-349595fb-6f42-45b5-8ab4-7f0d5e3afd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:25.210817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dddab-23b9-480e-a56d-990b358ad96c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.258992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 978/1977] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:25.259993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349595fb-6f42-45b5-8ab4-7f0d5e3afd12 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.267552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-349595fb-6f42-45b5-8ab4-7f0d5e3afd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:25.284660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349595fb-6f42-45b5-8ab4-7f0d5e3afd12 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.288271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a79867-3318-4eb2-83b7-24c3232df7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.288939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a79867-3318-4eb2-83b7-24c3232df7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.289225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a79867-3318-4eb2-83b7-24c3232df7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.289504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a79867-3318-4eb2-83b7-24c3232df7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.291752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-62a79867-3318-4eb2-83b7-24c3232df7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:25.291985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.292879 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.293272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.293576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] PATH_INFO: `/v3/projects/070c0aaccdde4974a58b6f7e04b18a87` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.294843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070c0aaccdde4974a58b6f7e04b18a87)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.296818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.304394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a79867-3318-4eb2-83b7-24c3232df7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.305976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a79867-3318-4eb2-83b7-24c3232df7f7 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.315658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1000/1978] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:25.319003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4810b-a2e6-4502-9507-4b45bd377b2c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.319321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4810b-a2e6-4502-9507-4b45bd377b2c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.320197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4810b-a2e6-4502-9507-4b45bd377b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.340397 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e0a4810b-a2e6-4502-9507-4b45bd377b2c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:25.341659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e0a4810b-a2e6-4502-9507-4b45bd377b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:25.351855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070c0aaccdde4974a58b6f7e04b18a87', 'request_id': 'req-7969e34c-3212-4625-a81c-3011bbc3c527'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.362005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070c0aaccdde4974a58b6f7e04b18a87', 'request_id': 'req-7969e34c-3212-4625-a81c-3011bbc3c527'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.371304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070c0aaccdde4974a58b6f7e04b18a87', 'request_id': 'req-7969e34c-3212-4625-a81c-3011bbc3c527'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.386930 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] The token cache is being invalidate because project 070c0aaccdde4974a58b6f7e04b18a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:25.387243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.388302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7969e34c-3212-4625-a81c-3011bbc3c527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:25.389778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 979/1979] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:25 2022] DELETE /identity/v3/projects/070c0aaccdde4974a58b6f7e04b18a87 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:25.395734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011a73d-d5a8-4094-8ab7-24998822bda1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.396561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011a73d-d5a8-4094-8ab7-24998822bda1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.396931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011a73d-d5a8-4094-8ab7-24998822bda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.419348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1001/1980] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:25.420621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4011a73d-d5a8-4094-8ab7-24998822bda1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:25.421900 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4011a73d-d5a8-4094-8ab7-24998822bda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:25.424309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4810b-a2e6-4502-9507-4b45bd377b2c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.439771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 980/1981] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:25.443157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4810b-a2e6-4502-9507-4b45bd377b2c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.447966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214a041-72db-481f-b0fe-0fd5cb3e313a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.448256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214a041-72db-481f-b0fe-0fd5cb3e313a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.448533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214a041-72db-481f-b0fe-0fd5cb3e313a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.451994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1169af-7dba-45ce-abca-a69a11fbd150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.453003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1169af-7dba-45ce-abca-a69a11fbd150 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.453595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1169af-7dba-45ce-abca-a69a11fbd150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.454139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1169af-7dba-45ce-abca-a69a11fbd150 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.456602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1169af-7dba-45ce-abca-a69a11fbd150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:25.457785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1169af-7dba-45ce-abca-a69a11fbd150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.459746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1169af-7dba-45ce-abca-a69a11fbd150 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.471383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b214a041-72db-481f-b0fe-0fd5cb3e313a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:25.473300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1002/1982] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:25.476637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b214a041-72db-481f-b0fe-0fd5cb3e313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:25.479486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1169af-7dba-45ce-abca-a69a11fbd150 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.492529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1169af-7dba-45ce-abca-a69a11fbd150 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.498946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab34b5-4078-4c43-8cb1-d92103ee5f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.499130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab34b5-4078-4c43-8cb1-d92103ee5f70 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.499423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab34b5-4078-4c43-8cb1-d92103ee5f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.499852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab34b5-4078-4c43-8cb1-d92103ee5f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.500555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab34b5-4078-4c43-8cb1-d92103ee5f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.503258 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab34b5-4078-4c43-8cb1-d92103ee5f70 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.505171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 981/1983] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:25.506393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214a041-72db-481f-b0fe-0fd5cb3e313a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.517192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214a041-72db-481f-b0fe-0fd5cb3e313a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.523356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a45c4-e6c8-44a6-b3fd-74b552646288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.524322 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a45c4-e6c8-44a6-b3fd-74b552646288 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.524809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a45c4-e6c8-44a6-b3fd-74b552646288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.525302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a45c4-e6c8-44a6-b3fd-74b552646288 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.526801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a45c4-e6c8-44a6-b3fd-74b552646288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:25.527357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a45c4-e6c8-44a6-b3fd-74b552646288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.528974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a45c4-e6c8-44a6-b3fd-74b552646288 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.539993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1003/1984] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:25 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:25.544099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab34b5-4078-4c43-8cb1-d92103ee5f70 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.555664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 982/1985] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:25.562775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a45c4-e6c8-44a6-b3fd-74b552646288 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.574926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a45c4-e6c8-44a6-b3fd-74b552646288 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.652252 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f1e2-65aa-42d5-8a61-335b6a5ad8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.654251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f1e2-65aa-42d5-8a61-335b6a5ad8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.655532 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f1e2-65aa-42d5-8a61-335b6a5ad8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.657381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f1e2-65aa-42d5-8a61-335b6a5ad8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.660802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9f1e2-65aa-42d5-8a61-335b6a5ad8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.664618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9f1e2-65aa-42d5-8a61-335b6a5ad8d0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.706886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab34b5-4078-4c43-8cb1-d92103ee5f70 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.716155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20448f95-521f-4384-943e-fcd534710c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.716847 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20448f95-521f-4384-943e-fcd534710c08 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.717334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20448f95-521f-4384-943e-fcd534710c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.717649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20448f95-521f-4384-943e-fcd534710c08 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.718412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20448f95-521f-4384-943e-fcd534710c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.720488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20448f95-521f-4384-943e-fcd534710c08 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.733255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 983/1986] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:25 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:25.740730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f1e2-65aa-42d5-8a61-335b6a5ad8d0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.751045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1004/1987] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:25 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:25.752675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20448f95-521f-4384-943e-fcd534710c08 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.779359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20448f95-521f-4384-943e-fcd534710c08 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.861840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f1e2-65aa-42d5-8a61-335b6a5ad8d0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.876354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264d7d0-31f6-45c7-b751-9a28cc4628d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.877501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264d7d0-31f6-45c7-b751-9a28cc4628d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.878041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264d7d0-31f6-45c7-b751-9a28cc4628d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.878574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264d7d0-31f6-45c7-b751-9a28cc4628d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.880062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264d7d0-31f6-45c7-b751-9a28cc4628d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.886785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264d7d0-31f6-45c7-b751-9a28cc4628d0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.921156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cc203-87ed-4a2a-9602-5d3427abb8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.930423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cc203-87ed-4a2a-9602-5d3427abb8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.930721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cc203-87ed-4a2a-9602-5d3427abb8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.931050 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cc203-87ed-4a2a-9602-5d3427abb8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.932331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cc203-87ed-4a2a-9602-5d3427abb8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.934353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cc203-87ed-4a2a-9602-5d3427abb8b8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.937923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 984/1988] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:25 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:25.937923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264d7d0-31f6-45c7-b751-9a28cc4628d0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.938161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3264d7d0-31f6-45c7-b751-9a28cc4628d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:25.949576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1005/1989] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:25.949576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cc203-87ed-4a2a-9602-5d3427abb8b8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:25.953975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264d7d0-31f6-45c7-b751-9a28cc4628d0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.959482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.960498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.961649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.961649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] PATH_INFO: `/v3/projects/c5d01400df034226b9701a604d562004` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.962619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d01400df034226b9701a604d562004)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.962889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cc203-87ed-4a2a-9602-5d3427abb8b8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:25.964832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.969016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cef609-c59f-4ac0-9b46-8f192d693e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:25.969455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef609-c59f-4ac0-9b46-8f192d693e77 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:25.969771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef609-c59f-4ac0-9b46-8f192d693e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:25.970050 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef609-c59f-4ac0-9b46-8f192d693e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:25.970786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cef609-c59f-4ac0-9b46-8f192d693e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:25.972525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cef609-c59f-4ac0-9b46-8f192d693e77 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:25.984176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1006/1990] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:25.985071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cef609-c59f-4ac0-9b46-8f192d693e77 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:26.012708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cef609-c59f-4ac0-9b46-8f192d693e77 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:26.023537 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d01400df034226b9701a604d562004', 'request_id': 'req-95ae991f-f459-4216-b440-a5b878107db1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.030650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d01400df034226b9701a604d562004', 'request_id': 'req-95ae991f-f459-4216-b440-a5b878107db1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.035985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d01400df034226b9701a604d562004', 'request_id': 'req-95ae991f-f459-4216-b440-a5b878107db1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.047567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] The token cache is being invalidate because project c5d01400df034226b9701a604d562004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:26.047970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.048630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.051054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 985/1991] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:25 2022] DELETE /identity/v3/projects/c5d01400df034226b9701a604d562004 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:26.051682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:26.053007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:26.079236 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce53e90-dad4-49e8-bb2f-ea1ed7564b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:26.080153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce53e90-dad4-49e8-bb2f-ea1ed7564b10 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:26.080502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce53e90-dad4-49e8-bb2f-ea1ed7564b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:26.081213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce53e90-dad4-49e8-bb2f-ea1ed7564b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:26.082287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce53e90-dad4-49e8-bb2f-ea1ed7564b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:26.084176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce53e90-dad4-49e8-bb2f-ea1ed7564b10 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:26.097326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1007/1992] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:26.097326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce53e90-dad4-49e8-bb2f-ea1ed7564b10 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:26.098568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-cce53e90-dad4-49e8-bb2f-ea1ed7564b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:26.110743 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce53e90-dad4-49e8-bb2f-ea1ed7564b10 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:26.116084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:26.116929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:26.117210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:26.117324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae991f-f459-4216-b440-a5b878107db1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:26.117897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] PATH_INFO: `/v3/users/70bd66a6aaf444409e291bb0125a61e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:26.118757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bd66a6aaf444409e291bb0125a61e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:26.120606 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:26.127408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4940c36-1717-4cfb-a32e-630bc9ff7a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:26.127408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940c36-1717-4cfb-a32e-630bc9ff7a2b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:26.127408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940c36-1717-4cfb-a32e-630bc9ff7a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:26.127408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940c36-1717-4cfb-a32e-630bc9ff7a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:26.127805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4940c36-1717-4cfb-a32e-630bc9ff7a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:26.127805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4940c36-1717-4cfb-a32e-630bc9ff7a2b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:26.136674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 986/1993] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:26.137515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4940c36-1717-4cfb-a32e-630bc9ff7a2b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:26.141479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d4940c36-1717-4cfb-a32e-630bc9ff7a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:26.154617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4940c36-1717-4cfb-a32e-630bc9ff7a2b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:26.159801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfadbd8-b6eb-4ee8-9baf-4a3e6323ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:26.160963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfadbd8-b6eb-4ee8-9baf-4a3e6323ebb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:26.161188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfadbd8-b6eb-4ee8-9baf-4a3e6323ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:26.161483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfadbd8-b6eb-4ee8-9baf-4a3e6323ebb7 admin admin] PATH_INFO: `/v3/projects/86e71bd9c8474ff39d5317b0b3c14a7f/users/e4da98d45e3d4d7ca673225a9806a3bc/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:26.179870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfadbd8-b6eb-4ee8-9baf-4a3e6323ebb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e71bd9c8474ff39d5317b0b3c14a7f, user_id=e4da98d45e3d4d7ca673225a9806a3bc, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:26.182695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfadbd8-b6eb-4ee8-9baf-4a3e6323ebb7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:26.197556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bd66a6aaf444409e291bb0125a61e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.198852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bd66a6aaf444409e291bb0125a61e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.205699 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 987/1994] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:26 2022] PUT /identity/v3/projects/86e71bd9c8474ff39d5317b0b3c14a7f/users/e4da98d45e3d4d7ca673225a9806a3bc/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:26.206587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfadbd8-b6eb-4ee8-9baf-4a3e6323ebb7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:26.215709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bd66a6aaf444409e291bb0125a61e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.216433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bd66a6aaf444409e291bb0125a61e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.225565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a6d3259f-aca6-44f3-a924-5fc4483035e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bd66a6aaf444409e291bb0125a61e3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:26.239309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1008/1995] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:26 2022] DELETE /identity/v3/users/70bd66a6aaf444409e291bb0125a61e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:26.240619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c8ecf-4ca2-4001-a252-e27f92e6f534 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:26.240909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c8ecf-4ca2-4001-a252-e27f92e6f534 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:26.241312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c8ecf-4ca2-4001-a252-e27f92e6f534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:26.270031 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d33c8ecf-4ca2-4001-a252-e27f92e6f534 None None] MFA Rules not processed for user `e4da98d45e3d4d7ca673225a9806a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:26.271275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d33c8ecf-4ca2-4001-a252-e27f92e6f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:26.280524 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfadbd8-b6eb-4ee8-9baf-4a3e6323ebb7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:26.359911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1009/1996] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:26.365816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2c1db-b593-4dc0-b257-00c7b7515663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:26.366915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2c1db-b593-4dc0-b257-00c7b7515663 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:26.367206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2c1db-b593-4dc0-b257-00c7b7515663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:26.367482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2c1db-b593-4dc0-b257-00c7b7515663 admin admin] PATH_INFO: `/v3/projects/eaa15fce85124ffb9a12a722d7463bba/users/ef5e9b90626c4991b3e6a6623f7b4148/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:26.369122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c8ecf-4ca2-4001-a252-e27f92e6f534 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:26.370687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d33c8ecf-4ca2-4001-a252-e27f92e6f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:26.389140 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2c1db-b593-4dc0-b257-00c7b7515663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa15fce85124ffb9a12a722d7463bba, user_id=ef5e9b90626c4991b3e6a6623f7b4148, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:26.392568 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2c1db-b593-4dc0-b257-00c7b7515663 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:26.410856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 988/1997] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:26 2022] PUT /identity/v3/projects/eaa15fce85124ffb9a12a722d7463bba/users/ef5e9b90626c4991b3e6a6623f7b4148/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:26.423771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0bdd-faec-4300-9e23-4299ad89fb03 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:26.424094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0bdd-faec-4300-9e23-4299ad89fb03 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:26.424341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0bdd-faec-4300-9e23-4299ad89fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:26.464929 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-108e0bdd-faec-4300-9e23-4299ad89fb03 None None] MFA Rules not processed for user `ef5e9b90626c4991b3e6a6623f7b4148`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:26.465595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c8ecf-4ca2-4001-a252-e27f92e6f534 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:26.466245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-108e0bdd-faec-4300-9e23-4299ad89fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:26.545397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 989/1998] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:26.557059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951212b3-d3da-471f-bba3-15d3e0a7df83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:26.557477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0bdd-faec-4300-9e23-4299ad89fb03 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:26.557918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951212b3-d3da-471f-bba3-15d3e0a7df83 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:26.558409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951212b3-d3da-471f-bba3-15d3e0a7df83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:26.558774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951212b3-d3da-471f-bba3-15d3e0a7df83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:26.558969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-108e0bdd-faec-4300-9e23-4299ad89fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:26.576918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0bdd-faec-4300-9e23-4299ad89fb03 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:26.581252 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0309b-b83a-46a4-a281-86c875055ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:26.582541 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0309b-b83a-46a4-a281-86c875055ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:26.582825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0309b-b83a-46a4-a281-86c875055ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:26.583100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0309b-b83a-46a4-a281-86c875055ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:26.598785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0309b-b83a-46a4-a281-86c875055ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:26.600236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0309b-b83a-46a4-a281-86c875055ec2 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:26.610738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 990/1999] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:00:26.637178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951212b3-d3da-471f-bba3-15d3e0a7df83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:26.638754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951212b3-d3da-471f-bba3-15d3e0a7df83 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:26.649476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1010/2000] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:00:27.219237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0309b-b83a-46a4-a281-86c875055ec2 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:27.220894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-96a0309b-b83a-46a4-a281-86c875055ec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:27.318113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0309b-b83a-46a4-a281-86c875055ec2 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:27.323311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:27.324627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:27.325223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:27.325622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] PATH_INFO: `/v3/projects/0e5851ef149d420ba8401d3e32331b36` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:27.326885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5851ef149d420ba8401d3e32331b36)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:27.329175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:27.384334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5851ef149d420ba8401d3e32331b36', 'request_id': 'req-71159041-4de0-4b2f-948d-69e1e864a8f1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.392189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5851ef149d420ba8401d3e32331b36', 'request_id': 'req-71159041-4de0-4b2f-948d-69e1e864a8f1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.399267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5851ef149d420ba8401d3e32331b36', 'request_id': 'req-71159041-4de0-4b2f-948d-69e1e864a8f1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.412174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] The token cache is being invalidate because project 0e5851ef149d420ba8401d3e32331b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:27.412460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.413097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.414719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 991/2001] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:27 2022] DELETE /identity/v3/projects/0e5851ef149d420ba8401d3e32331b36 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:27.419425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951212b3-d3da-471f-bba3-15d3e0a7df83 service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:27.430711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951212b3-d3da-471f-bba3-15d3e0a7df83 service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:27.506527 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:27.507485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:27.507765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:27.508042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] PATH_INFO: `/v3/users/fd096c642dbb4798854f5ec57494a58e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:27.509907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd096c642dbb4798854f5ec57494a58e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:27.511907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:27.556649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd096c642dbb4798854f5ec57494a58e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.557304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd096c642dbb4798854f5ec57494a58e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.570695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd096c642dbb4798854f5ec57494a58e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.571315 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd096c642dbb4798854f5ec57494a58e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.579564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bff000b0-f60f-41c3-8c4e-562184062b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd096c642dbb4798854f5ec57494a58e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:27.591912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1011/2002] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:27 2022] DELETE /identity/v3/users/fd096c642dbb4798854f5ec57494a58e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:27.899461 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:27.900927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:27.914648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71159041-4de0-4b2f-948d-69e1e864a8f1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:27.975177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:27.976024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:27.976353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:27.976627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] PATH_INFO: `/v3/projects/dee14f213b0348d89f98d7cb54749a7e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:27.977847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee14f213b0348d89f98d7cb54749a7e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:27.979882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:28.036613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee14f213b0348d89f98d7cb54749a7e', 'request_id': 'req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:28.045913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee14f213b0348d89f98d7cb54749a7e', 'request_id': 'req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:28.052048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee14f213b0348d89f98d7cb54749a7e', 'request_id': 'req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:28.064591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] The token cache is being invalidate because project dee14f213b0348d89f98d7cb54749a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:28.064956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:28.065651 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3aa8b6bb-0a38-4fc9-8094-b7e2001bcf02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:28.068214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 992/2003] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:27 2022] DELETE /identity/v3/projects/dee14f213b0348d89f98d7cb54749a7e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:28.072655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e5c28-7431-4d48-ac03-ab6c025d91b9 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.072994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e5c28-7431-4d48-ac03-ab6c025d91b9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.073214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e5c28-7431-4d48-ac03-ab6c025d91b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.091518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1a0e5c28-7431-4d48-ac03-ab6c025d91b9 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:28.092736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1a0e5c28-7431-4d48-ac03-ab6c025d91b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:28.171749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1012/2004] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:28.179862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bfbec-664c-4261-920f-658fc99455c7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.180166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bfbec-664c-4261-920f-658fc99455c7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.180437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bfbec-664c-4261-920f-658fc99455c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.218093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f47bfbec-664c-4261-920f-658fc99455c7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:28.219394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f47bfbec-664c-4261-920f-658fc99455c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:28.240891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 993/2005] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:28.245252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e5c28-7431-4d48-ac03-ab6c025d91b9 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:28.256496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e5c28-7431-4d48-ac03-ab6c025d91b9 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:28.269207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aad280-b08c-4dba-91bb-09f569989a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:28.272344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aad280-b08c-4dba-91bb-09f569989a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.272661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aad280-b08c-4dba-91bb-09f569989a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.272951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aad280-b08c-4dba-91bb-09f569989a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.273746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aad280-b08c-4dba-91bb-09f569989a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:28.274032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aad280-b08c-4dba-91bb-09f569989a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:28.275650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aad280-b08c-4dba-91bb-09f569989a3d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:28.294215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1013/2006] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:28.294387 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bfbec-664c-4261-920f-658fc99455c7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:28.305202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bfbec-664c-4261-920f-658fc99455c7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:28.310662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb637-daf6-4c2e-9bb3-fa42674695ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:28.311319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb637-daf6-4c2e-9bb3-fa42674695ac admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.311607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb637-daf6-4c2e-9bb3-fa42674695ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.311886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb637-daf6-4c2e-9bb3-fa42674695ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.312601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcb637-daf6-4c2e-9bb3-fa42674695ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:28.314563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcb637-daf6-4c2e-9bb3-fa42674695ac admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:28.344634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 994/2007] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:28 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:28.349234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aad280-b08c-4dba-91bb-09f569989a3d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:28.359388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aad280-b08c-4dba-91bb-09f569989a3d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:28.423051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65be3d-8398-4b44-ae69-f0cb3947b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:28.423726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65be3d-8398-4b44-ae69-f0cb3947b4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.424028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65be3d-8398-4b44-ae69-f0cb3947b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.424294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65be3d-8398-4b44-ae69-f0cb3947b4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.425010 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65be3d-8398-4b44-ae69-f0cb3947b4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:28.427048 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65be3d-8398-4b44-ae69-f0cb3947b4c1 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:28.447387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1014/2008] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:28 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:28.451982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb637-daf6-4c2e-9bb3-fa42674695ac admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:28.467314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb637-daf6-4c2e-9bb3-fa42674695ac admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:28.478053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6662ca-6ca2-46ce-abdf-e7613331d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:28.478745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6662ca-6ca2-46ce-abdf-e7613331d12a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.479161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6662ca-6ca2-46ce-abdf-e7613331d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.479642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6662ca-6ca2-46ce-abdf-e7613331d12a admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.480995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6662ca-6ca2-46ce-abdf-e7613331d12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:28.483299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6662ca-6ca2-46ce-abdf-e7613331d12a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:28.500623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 995/2009] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:28.506599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65be3d-8398-4b44-ae69-f0cb3947b4c1 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:28.516671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65be3d-8398-4b44-ae69-f0cb3947b4c1 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:28.522126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48924fbe-cf4d-4baf-bbd4-4ac5f30c7531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:28.522913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48924fbe-cf4d-4baf-bbd4-4ac5f30c7531 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.523276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48924fbe-cf4d-4baf-bbd4-4ac5f30c7531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.523653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48924fbe-cf4d-4baf-bbd4-4ac5f30c7531 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.524453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48924fbe-cf4d-4baf-bbd4-4ac5f30c7531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:28.526923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48924fbe-cf4d-4baf-bbd4-4ac5f30c7531 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:28.541913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1015/2010] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:28.551609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6662ca-6ca2-46ce-abdf-e7613331d12a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:28.562803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6662ca-6ca2-46ce-abdf-e7613331d12a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:28.567627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3964c-5593-4c92-b332-1bd6fbfc1a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:28.568526 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3964c-5593-4c92-b332-1bd6fbfc1a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.568808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3964c-5593-4c92-b332-1bd6fbfc1a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.569083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3964c-5593-4c92-b332-1bd6fbfc1a18 admin admin] PATH_INFO: `/v3/projects/8201f97cea5f4ea89d4f3f58227e8d99/users/6ac0f914719a4b118d420a744a14102b/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.586452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3964c-5593-4c92-b332-1bd6fbfc1a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8201f97cea5f4ea89d4f3f58227e8d99, user_id=6ac0f914719a4b118d420a744a14102b, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:28.589267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3964c-5593-4c92-b332-1bd6fbfc1a18 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:28.605641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 996/2011] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:28 2022] PUT /identity/v3/projects/8201f97cea5f4ea89d4f3f58227e8d99/users/6ac0f914719a4b118d420a744a14102b/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:28.615980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f3c5e-01b5-4f6b-b1d4-4bcb354d36d0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.616275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f3c5e-01b5-4f6b-b1d4-4bcb354d36d0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.616857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f3c5e-01b5-4f6b-b1d4-4bcb354d36d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.645296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-057f3c5e-01b5-4f6b-b1d4-4bcb354d36d0 None None] MFA Rules not processed for user `6ac0f914719a4b118d420a744a14102b`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:28.646673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-057f3c5e-01b5-4f6b-b1d4-4bcb354d36d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:28.712361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1016/2012] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:28.723430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3964c-5593-4c92-b332-1bd6fbfc1a18 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:28.725114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3fd3964c-5593-4c92-b332-1bd6fbfc1a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:28.781870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3964c-5593-4c92-b332-1bd6fbfc1a18 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:28.786152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2debaa-f907-479d-a059-ab856924c72e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:28.786801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2debaa-f907-479d-a059-ab856924c72e service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:28.787092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2debaa-f907-479d-a059-ab856924c72e service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:28.787370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2debaa-f907-479d-a059-ab856924c72e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:28.796464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2debaa-f907-479d-a059-ab856924c72e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:28.797953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2debaa-f907-479d-a059-ab856924c72e service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:28.806689 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 997/2013] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:36.592767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f3c5e-01b5-4f6b-b1d4-4bcb354d36d0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:36.664650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f3c5e-01b5-4f6b-b1d4-4bcb354d36d0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:36.671384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:36.671984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:36.672383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:36.673120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] PATH_INFO: `/v3/users/6ac0f914719a4b118d420a744a14102b` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:36.674231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac0f914719a4b118d420a744a14102b)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:36.680633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:36.734560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac0f914719a4b118d420a744a14102b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:36.735202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac0f914719a4b118d420a744a14102b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:36.751853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac0f914719a4b118d420a744a14102b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:36.753764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac0f914719a4b118d420a744a14102b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:36.764464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac0f914719a4b118d420a744a14102b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:36.781057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1017/2014] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:36 2022] DELETE /identity/v3/users/6ac0f914719a4b118d420a744a14102b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:36.783197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142163c-6f6d-493e-aff3-ec81ea7fecc5 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:36.784304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142163c-6f6d-493e-aff3-ec81ea7fecc5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:36.784958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142163c-6f6d-493e-aff3-ec81ea7fecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:36.804828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3142163c-6f6d-493e-aff3-ec81ea7fecc5 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:36.806399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3142163c-6f6d-493e-aff3-ec81ea7fecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:36.880204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 998/2015] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:36.891263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:36.892699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:36.953748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc77e1-2dc7-40cf-891a-ea828e8dbada admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:36.957941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc08a4d-954e-4921-8aa6-9ccddd045248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:36.958592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc08a4d-954e-4921-8aa6-9ccddd045248 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:36.958877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc08a4d-954e-4921-8aa6-9ccddd045248 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:36.959218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc08a4d-954e-4921-8aa6-9ccddd045248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:36.968496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc08a4d-954e-4921-8aa6-9ccddd045248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:36.970110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc08a4d-954e-4921-8aa6-9ccddd045248 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:36.980096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1018/2016] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:37.282249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc08a4d-954e-4921-8aa6-9ccddd045248 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:37.282488 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142163c-6f6d-493e-aff3-ec81ea7fecc5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:37.283897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ddc08a4d-954e-4921-8aa6-9ccddd045248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:37.284115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3142163c-6f6d-493e-aff3-ec81ea7fecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:37.296724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142163c-6f6d-493e-aff3-ec81ea7fecc5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:37.303045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:37.303949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:37.304236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:37.304511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] PATH_INFO: `/v3/users/6dfc6f930dea4e83a4fc58c9b02276f6` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:37.305751 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfc6f930dea4e83a4fc58c9b02276f6)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:37.306960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc08a4d-954e-4921-8aa6-9ccddd045248 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:37.307872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:37.312465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:37.313622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:37.313943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:37.314267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] PATH_INFO: `/v3/projects/8201f97cea5f4ea89d4f3f58227e8d99` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:37.315367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8201f97cea5f4ea89d4f3f58227e8d99)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:37.318101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:37.365724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfc6f930dea4e83a4fc58c9b02276f6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.366712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8201f97cea5f4ea89d4f3f58227e8d99', 'request_id': 'req-73a654b0-6276-4a85-8906-8ad0e44c681a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.374242 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8201f97cea5f4ea89d4f3f58227e8d99', 'request_id': 'req-73a654b0-6276-4a85-8906-8ad0e44c681a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.379365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfc6f930dea4e83a4fc58c9b02276f6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.381744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8201f97cea5f4ea89d4f3f58227e8d99', 'request_id': 'req-73a654b0-6276-4a85-8906-8ad0e44c681a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.386166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfc6f930dea4e83a4fc58c9b02276f6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.386858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfc6f930dea4e83a4fc58c9b02276f6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.393467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] The token cache is being invalidate because project 8201f97cea5f4ea89d4f3f58227e8d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:37.393816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.395115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.395235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2ad51158-34c5-4739-856a-59d0c06d2f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfc6f930dea4e83a4fc58c9b02276f6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.396436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1019/2017] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:37 2022] DELETE /identity/v3/projects/8201f97cea5f4ea89d4f3f58227e8d99 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:37.401202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 999/2018] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:37 2022] DELETE /identity/v3/users/6dfc6f930dea4e83a4fc58c9b02276f6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:37.603389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:37.604992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:37.675592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a654b0-6276-4a85-8906-8ad0e44c681a admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:37.734920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:37.735855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:37.736037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:37.736307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] PATH_INFO: `/v3/projects/61be60da66374c5b9c064eefb5b54dfe` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:37.738080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] RBAC: Authorizing `identity:delete_project(project_id=61be60da66374c5b9c064eefb5b54dfe)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:37.741054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:37.788439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61be60da66374c5b9c064eefb5b54dfe', 'request_id': 'req-14004d75-8858-4a21-ad4f-3fe78db6d2be'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.796843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61be60da66374c5b9c064eefb5b54dfe', 'request_id': 'req-14004d75-8858-4a21-ad4f-3fe78db6d2be'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.803685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61be60da66374c5b9c064eefb5b54dfe', 'request_id': 'req-14004d75-8858-4a21-ad4f-3fe78db6d2be'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.813422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] The token cache is being invalidate because project 61be60da66374c5b9c064eefb5b54dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:37.813740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.814356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-14004d75-8858-4a21-ad4f-3fe78db6d2be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:37.816181 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1020/2019] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:37 2022] DELETE /identity/v3/projects/61be60da66374c5b9c064eefb5b54dfe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:37.820788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813179d-e75a-4c38-a2c3-286e7327ef22 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:37.821278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813179d-e75a-4c38-a2c3-286e7327ef22 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:37.821369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813179d-e75a-4c38-a2c3-286e7327ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:37.839709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0813179d-e75a-4c38-a2c3-286e7327ef22 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:37.840911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0813179d-e75a-4c38-a2c3-286e7327ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:37.900917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1000/2020] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:37.908664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941847-3e0d-4b9d-90be-696c7e8ae463 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:37.908954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941847-3e0d-4b9d-90be-696c7e8ae463 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:37.909301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941847-3e0d-4b9d-90be-696c7e8ae463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:37.927599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b3941847-3e0d-4b9d-90be-696c7e8ae463 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:37.928787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b3941847-3e0d-4b9d-90be-696c7e8ae463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:37.936515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1021/2021] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:37.940469 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813179d-e75a-4c38-a2c3-286e7327ef22 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:37.950086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813179d-e75a-4c38-a2c3-286e7327ef22 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:37.954803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9d2c2-8a98-484a-9246-25b7ec1509d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:37.955515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9d2c2-8a98-484a-9246-25b7ec1509d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:37.955731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9d2c2-8a98-484a-9246-25b7ec1509d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:37.956551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9d2c2-8a98-484a-9246-25b7ec1509d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:37.957441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9d2c2-8a98-484a-9246-25b7ec1509d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:37.957780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9d2c2-8a98-484a-9246-25b7ec1509d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:37.959359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9d2c2-8a98-484a-9246-25b7ec1509d0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:37.971540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1001/2022] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:37.976443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941847-3e0d-4b9d-90be-696c7e8ae463 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:37.985740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941847-3e0d-4b9d-90be-696c7e8ae463 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:37.990601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494fc9a-ef97-4cd4-9ec3-74c81d9cfff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:37.991252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494fc9a-ef97-4cd4-9ec3-74c81d9cfff5 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:37.991531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494fc9a-ef97-4cd4-9ec3-74c81d9cfff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:37.991801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494fc9a-ef97-4cd4-9ec3-74c81d9cfff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:37.992483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494fc9a-ef97-4cd4-9ec3-74c81d9cfff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:37.994584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494fc9a-ef97-4cd4-9ec3-74c81d9cfff5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:38.022865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1022/2023] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:37 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:38.024215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9d2c2-8a98-484a-9246-25b7ec1509d0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:38.037068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9d2c2-8a98-484a-9246-25b7ec1509d0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:38.095447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb0d71-ac28-4b22-a774-4677df2fe234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:38.096119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb0d71-ac28-4b22-a774-4677df2fe234 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:38.096400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb0d71-ac28-4b22-a774-4677df2fe234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:38.096724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb0d71-ac28-4b22-a774-4677df2fe234 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:38.097972 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb0d71-ac28-4b22-a774-4677df2fe234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:38.100070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb0d71-ac28-4b22-a774-4677df2fe234 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:38.121904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1002/2024] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:38 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:38.123096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494fc9a-ef97-4cd4-9ec3-74c81d9cfff5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:38.133452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494fc9a-ef97-4cd4-9ec3-74c81d9cfff5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:38.138099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac3c93-b3b8-473b-b3bb-1dde2e69cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:38.138760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac3c93-b3b8-473b-b3bb-1dde2e69cea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:38.139050 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac3c93-b3b8-473b-b3bb-1dde2e69cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:38.139325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac3c93-b3b8-473b-b3bb-1dde2e69cea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:38.140046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac3c93-b3b8-473b-b3bb-1dde2e69cea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:38.141668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac3c93-b3b8-473b-b3bb-1dde2e69cea2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:38.152703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1023/2025] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:38.156463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb0d71-ac28-4b22-a774-4677df2fe234 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:38.168952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb0d71-ac28-4b22-a774-4677df2fe234 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:38.176400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15e55d-5bfa-4d83-ba04-656b45bec549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:38.177065 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e55d-5bfa-4d83-ba04-656b45bec549 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:38.177345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e55d-5bfa-4d83-ba04-656b45bec549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:38.177672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e55d-5bfa-4d83-ba04-656b45bec549 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:38.180258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15e55d-5bfa-4d83-ba04-656b45bec549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:38.182038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15e55d-5bfa-4d83-ba04-656b45bec549 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:38.195894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1003/2026] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:38.196864 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac3c93-b3b8-473b-b3bb-1dde2e69cea2 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:38.207842 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac3c93-b3b8-473b-b3bb-1dde2e69cea2 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:38.212400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55dc2-fedb-4b34-b4fa-0468db8eee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:38.213275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55dc2-fedb-4b34-b4fa-0468db8eee5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:38.213596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55dc2-fedb-4b34-b4fa-0468db8eee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:38.213867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55dc2-fedb-4b34-b4fa-0468db8eee5b admin admin] PATH_INFO: `/v3/projects/7ac9a0b337c54e84ba4d593e09c212e6/users/5b4d5f4f01a64df7b0af4a83dcdabbd2/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:38.228736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a55dc2-fedb-4b34-b4fa-0468db8eee5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac9a0b337c54e84ba4d593e09c212e6, user_id=5b4d5f4f01a64df7b0af4a83dcdabbd2, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:38.231373 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a55dc2-fedb-4b34-b4fa-0468db8eee5b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:38.243887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1024/2027] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:38 2022] PUT /identity/v3/projects/7ac9a0b337c54e84ba4d593e09c212e6/users/5b4d5f4f01a64df7b0af4a83dcdabbd2/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:38.249152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319b852-1157-4600-bfd8-bcfc8b698d31 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:38.249609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319b852-1157-4600-bfd8-bcfc8b698d31 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:38.249957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319b852-1157-4600-bfd8-bcfc8b698d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:38.268151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8319b852-1157-4600-bfd8-bcfc8b698d31 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:38.270006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8319b852-1157-4600-bfd8-bcfc8b698d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:38.330580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1004/2028] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:38.341578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55dc2-fedb-4b34-b4fa-0468db8eee5b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:38.343441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-31a55dc2-fedb-4b34-b4fa-0468db8eee5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:38.401015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55dc2-fedb-4b34-b4fa-0468db8eee5b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:38.405041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497670e-81e3-49fd-8528-01aafd5b8dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:38.405718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497670e-81e3-49fd-8528-01aafd5b8dfd service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:38.406023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497670e-81e3-49fd-8528-01aafd5b8dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:38.406302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497670e-81e3-49fd-8528-01aafd5b8dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:38.415978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497670e-81e3-49fd-8528-01aafd5b8dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:38.417434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497670e-81e3-49fd-8528-01aafd5b8dfd service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:38.427446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1025/2029] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:39.038996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01929f-945e-4794-8331-d85967055b3b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:39.039514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01929f-945e-4794-8331-d85967055b3b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:39.039616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01929f-945e-4794-8331-d85967055b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:39.067902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3e01929f-945e-4794-8331-d85967055b3b None None] MFA Rules not processed for user `5b4d5f4f01a64df7b0af4a83dcdabbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:39.069122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3e01929f-945e-4794-8331-d85967055b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:39.197857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1005/2030] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:39.202642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497670e-81e3-49fd-8528-01aafd5b8dfd service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:39.214961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497670e-81e3-49fd-8528-01aafd5b8dfd service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:39.220314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8010c-3364-41f2-b2c3-746db5b6fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:39.222552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8010c-3364-41f2-b2c3-746db5b6fc21 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:39.222875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8010c-3364-41f2-b2c3-746db5b6fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:39.223150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8010c-3364-41f2-b2c3-746db5b6fc21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:39.224436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8010c-3364-41f2-b2c3-746db5b6fc21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:39.226435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8010c-3364-41f2-b2c3-746db5b6fc21 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:39.254691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1026/2031] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:39 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:39.258858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01929f-945e-4794-8331-d85967055b3b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:39.271293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01929f-945e-4794-8331-d85967055b3b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:39.334773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e50b5-9b3e-4aff-a47c-05e955a5a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:39.335593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e50b5-9b3e-4aff-a47c-05e955a5a7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:39.335943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e50b5-9b3e-4aff-a47c-05e955a5a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:39.336324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e50b5-9b3e-4aff-a47c-05e955a5a7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:39.337099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e50b5-9b3e-4aff-a47c-05e955a5a7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:39.339143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e50b5-9b3e-4aff-a47c-05e955a5a7a7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:39.363344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1006/2032] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:39 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:39.364543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8010c-3364-41f2-b2c3-746db5b6fc21 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:39.374762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8010c-3364-41f2-b2c3-746db5b6fc21 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:39.379516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c2074-0a3c-4b18-863a-a30debe06b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:39.380173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c2074-0a3c-4b18-863a-a30debe06b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:39.380455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c2074-0a3c-4b18-863a-a30debe06b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:39.380728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c2074-0a3c-4b18-863a-a30debe06b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:39.381465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c2074-0a3c-4b18-863a-a30debe06b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:39.383092 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c2074-0a3c-4b18-863a-a30debe06b4d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:39.394199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1027/2033] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:39.398295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e50b5-9b3e-4aff-a47c-05e955a5a7a7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:39.408089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e50b5-9b3e-4aff-a47c-05e955a5a7a7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:39.413201 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166b33-0e54-4793-a139-4642d1420e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:39.414101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166b33-0e54-4793-a139-4642d1420e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:39.414385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166b33-0e54-4793-a139-4642d1420e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:39.414657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166b33-0e54-4793-a139-4642d1420e0f admin admin] PATH_INFO: `/v3/projects/3c21e8861950472481b334575a0d00cd/users/06b627527870450ea72422fecb595e06/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:39.429055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166b33-0e54-4793-a139-4642d1420e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c21e8861950472481b334575a0d00cd, user_id=06b627527870450ea72422fecb595e06, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:39.431677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166b33-0e54-4793-a139-4642d1420e0f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:39.443956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1007/2034] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:39 2022] PUT /identity/v3/projects/3c21e8861950472481b334575a0d00cd/users/06b627527870450ea72422fecb595e06/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:39.447898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c2074-0a3c-4b18-863a-a30debe06b4d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:39.458249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c2074-0a3c-4b18-863a-a30debe06b4d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:39.512781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba7965-477c-4f6e-8116-4dab185303fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:39.513444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7965-477c-4f6e-8116-4dab185303fd admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:39.513763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7965-477c-4f6e-8116-4dab185303fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:39.514038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7965-477c-4f6e-8116-4dab185303fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:39.514785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7965-477c-4f6e-8116-4dab185303fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:39.516367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7965-477c-4f6e-8116-4dab185303fd admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:39.529212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1028/2035] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:39.530784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166b33-0e54-4793-a139-4642d1420e0f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:39.541754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166b33-0e54-4793-a139-4642d1420e0f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:39.546292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d85c7-cb9f-4513-9e98-6d5ecf442459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:39.547160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d85c7-cb9f-4513-9e98-6d5ecf442459 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:39.547455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d85c7-cb9f-4513-9e98-6d5ecf442459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:39.547715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d85c7-cb9f-4513-9e98-6d5ecf442459 admin admin] PATH_INFO: `/v3/projects/3c21e8861950472481b334575a0d00cd/users/06b627527870450ea72422fecb595e06/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:39.549724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d85c7-cb9f-4513-9e98-6d5ecf442459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c21e8861950472481b334575a0d00cd, user_id=06b627527870450ea72422fecb595e06, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:39.552354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d85c7-cb9f-4513-9e98-6d5ecf442459 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:39.562321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1008/2036] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:39 2022] PUT /identity/v3/projects/3c21e8861950472481b334575a0d00cd/users/06b627527870450ea72422fecb595e06/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:40.207586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172b3eb-3221-49ba-b81c-a7fef2a65904 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:40.208109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172b3eb-3221-49ba-b81c-a7fef2a65904 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:40.208612 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172b3eb-3221-49ba-b81c-a7fef2a65904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:40.236515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4172b3eb-3221-49ba-b81c-a7fef2a65904 None None] MFA Rules not processed for user `06b627527870450ea72422fecb595e06`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:40.237833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4172b3eb-3221-49ba-b81c-a7fef2a65904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:40.312264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1029/2037] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:41.386946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d85c7-cb9f-4513-9e98-6d5ecf442459 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:41.448681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d85c7-cb9f-4513-9e98-6d5ecf442459 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:41.453275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:41.454161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:41.454449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:41.454727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] PATH_INFO: `/v3/users/5b4d5f4f01a64df7b0af4a83dcdabbd2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:41.455906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4d5f4f01a64df7b0af4a83dcdabbd2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:41.457849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:41.507136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4d5f4f01a64df7b0af4a83dcdabbd2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.518338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4d5f4f01a64df7b0af4a83dcdabbd2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.524740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4d5f4f01a64df7b0af4a83dcdabbd2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.525407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4d5f4f01a64df7b0af4a83dcdabbd2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.533844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4d5f4f01a64df7b0af4a83dcdabbd2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.540608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1009/2038] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:41 2022] DELETE /identity/v3/users/5b4d5f4f01a64df7b0af4a83dcdabbd2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:41.722476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172b3eb-3221-49ba-b81c-a7fef2a65904 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:41.733187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172b3eb-3221-49ba-b81c-a7fef2a65904 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:41.789381 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:41.790443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:41.790726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:41.791002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] PATH_INFO: `/v3/projects/7ac9a0b337c54e84ba4d593e09c212e6` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:41.792165 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac9a0b337c54e84ba4d593e09c212e6)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:41.794087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:41.841485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac9a0b337c54e84ba4d593e09c212e6', 'request_id': 'req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.848608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac9a0b337c54e84ba4d593e09c212e6', 'request_id': 'req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.854746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac9a0b337c54e84ba4d593e09c212e6', 'request_id': 'req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.864474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] The token cache is being invalidate because project 7ac9a0b337c54e84ba4d593e09c212e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:41.865159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.865374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:41.866931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1030/2039] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:41 2022] DELETE /identity/v3/projects/7ac9a0b337c54e84ba4d593e09c212e6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:41.870917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:41.872318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:41.885490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea5b9e-841e-46ed-a237-09a868639313 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:41.940257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:41.941121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:41.941400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:41.941701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] PATH_INFO: `/v3/users/06b627527870450ea72422fecb595e06` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:41.942858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b627527870450ea72422fecb595e06)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:41.944747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:41.988941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b627527870450ea72422fecb595e06'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.000094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b627527870450ea72422fecb595e06'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.007125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b627527870450ea72422fecb595e06'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.007778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b627527870450ea72422fecb595e06'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.014745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-95adefed-c16d-4b09-ac99-d895ef4e8f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b627527870450ea72422fecb595e06'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.021014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1010/2040] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:41 2022] DELETE /identity/v3/users/06b627527870450ea72422fecb595e06 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:42.183423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:42.184936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:42.198892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432e2ac-1b0c-4ebf-9ce3-09d01f317c62 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:42.255233 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:42.256085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.256364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.256664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] PATH_INFO: `/v3/projects/3c21e8861950472481b334575a0d00cd` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.257856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c21e8861950472481b334575a0d00cd)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:42.259825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:42.303129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c21e8861950472481b334575a0d00cd', 'request_id': 'req-a4368e52-2df6-4785-8834-d0db41a8ee08'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.310134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c21e8861950472481b334575a0d00cd', 'request_id': 'req-a4368e52-2df6-4785-8834-d0db41a8ee08'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.316776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c21e8861950472481b334575a0d00cd', 'request_id': 'req-a4368e52-2df6-4785-8834-d0db41a8ee08'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.326503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] The token cache is being invalidate because project 3c21e8861950472481b334575a0d00cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:42.326783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.327390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a4368e52-2df6-4785-8834-d0db41a8ee08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:42.328886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1031/2041] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:42 2022] DELETE /identity/v3/projects/3c21e8861950472481b334575a0d00cd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:42.334395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f3ff-f483-4de2-872a-30e78e0a1886 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.334688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f3ff-f483-4de2-872a-30e78e0a1886 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.334970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f3ff-f483-4de2-872a-30e78e0a1886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.353039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7f98f3ff-f483-4de2-872a-30e78e0a1886 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:42.354270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7f98f3ff-f483-4de2-872a-30e78e0a1886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:42.411001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1011/2042] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:42.418823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181bbea-3179-40dc-92f3-11f182c0b8f0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.419105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181bbea-3179-40dc-92f3-11f182c0b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.419374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181bbea-3179-40dc-92f3-11f182c0b8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.436832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1181bbea-3179-40dc-92f3-11f182c0b8f0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:42.438042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1181bbea-3179-40dc-92f3-11f182c0b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:42.445669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1032/2043] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:42.449668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98f3ff-f483-4de2-872a-30e78e0a1886 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:42.459509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98f3ff-f483-4de2-872a-30e78e0a1886 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:42.464121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fea0-895b-4341-af2e-a41aae756197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:42.464765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fea0-895b-4341-af2e-a41aae756197 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.465050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fea0-895b-4341-af2e-a41aae756197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.465328 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fea0-895b-4341-af2e-a41aae756197 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.466096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617fea0-895b-4341-af2e-a41aae756197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:42.466407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617fea0-895b-4341-af2e-a41aae756197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:42.467997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617fea0-895b-4341-af2e-a41aae756197 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:42.479886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1012/2044] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:42.483939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181bbea-3179-40dc-92f3-11f182c0b8f0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:42.493473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181bbea-3179-40dc-92f3-11f182c0b8f0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:42.498079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969053c-50dd-4bd0-9323-85b9fa660994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:42.498716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969053c-50dd-4bd0-9323-85b9fa660994 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.499026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969053c-50dd-4bd0-9323-85b9fa660994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.499302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969053c-50dd-4bd0-9323-85b9fa660994 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.499993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969053c-50dd-4bd0-9323-85b9fa660994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:42.501925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969053c-50dd-4bd0-9323-85b9fa660994 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:42.528921 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1033/2045] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:42 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:42.532939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fea0-895b-4341-af2e-a41aae756197 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:42.543031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fea0-895b-4341-af2e-a41aae756197 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:42.597261 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3161a-8060-4f42-ba45-045d6e9c6856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:42.597888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3161a-8060-4f42-ba45-045d6e9c6856 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.598172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3161a-8060-4f42-ba45-045d6e9c6856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.598445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3161a-8060-4f42-ba45-045d6e9c6856 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.599126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3161a-8060-4f42-ba45-045d6e9c6856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:42.601060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3161a-8060-4f42-ba45-045d6e9c6856 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:42.619835 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1013/2046] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:42 2022] POST /identity/v3/users => generated 278 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:42.623880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969053c-50dd-4bd0-9323-85b9fa660994 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:42.634429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969053c-50dd-4bd0-9323-85b9fa660994 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:42.639301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb461f-d21a-4f1f-b9b1-e0b4bdfe4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:42.639946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb461f-d21a-4f1f-b9b1-e0b4bdfe4227 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.640229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb461f-d21a-4f1f-b9b1-e0b4bdfe4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.640505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb461f-d21a-4f1f-b9b1-e0b4bdfe4227 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.641226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb461f-d21a-4f1f-b9b1-e0b4bdfe4227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:42.642868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb461f-d21a-4f1f-b9b1-e0b4bdfe4227 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:42.652815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1034/2047] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:42.656643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3161a-8060-4f42-ba45-045d6e9c6856 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:42.666565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3161a-8060-4f42-ba45-045d6e9c6856 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:42.671067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4fe95-db83-4aa3-8fd7-eb825ade944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:42.671703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4fe95-db83-4aa3-8fd7-eb825ade944c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.671984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4fe95-db83-4aa3-8fd7-eb825ade944c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.672270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4fe95-db83-4aa3-8fd7-eb825ade944c admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.672971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4fe95-db83-4aa3-8fd7-eb825ade944c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:42.674577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4fe95-db83-4aa3-8fd7-eb825ade944c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:42.684483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1014/2048] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:42.688740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb461f-d21a-4f1f-b9b1-e0b4bdfe4227 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:42.700353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb461f-d21a-4f1f-b9b1-e0b4bdfe4227 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:42.705189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549d538-2af8-4c21-9312-85c47c492985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:42.706013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549d538-2af8-4c21-9312-85c47c492985 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.706296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549d538-2af8-4c21-9312-85c47c492985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.707019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549d538-2af8-4c21-9312-85c47c492985 admin admin] PATH_INFO: `/v3/projects/510aa5d1418b469281b53db7eaccf1d4/users/17e52a1316884d408797883ae2d01689/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.722552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549d538-2af8-4c21-9312-85c47c492985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510aa5d1418b469281b53db7eaccf1d4, user_id=17e52a1316884d408797883ae2d01689, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:42.725917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549d538-2af8-4c21-9312-85c47c492985 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:42.739189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1035/2049] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:42 2022] PUT /identity/v3/projects/510aa5d1418b469281b53db7eaccf1d4/users/17e52a1316884d408797883ae2d01689/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:42.751020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae6ef-d23d-4934-a633-94358af88fad None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.751308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae6ef-d23d-4934-a633-94358af88fad None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.751585 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae6ef-d23d-4934-a633-94358af88fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.777546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-35cae6ef-d23d-4934-a633-94358af88fad None None] MFA Rules not processed for user `17e52a1316884d408797883ae2d01689`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:42.778886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-35cae6ef-d23d-4934-a633-94358af88fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:42.844193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1015/2050] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:42 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:42.848583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549d538-2af8-4c21-9312-85c47c492985 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:42.910882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549d538-2af8-4c21-9312-85c47c492985 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:42.916667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e9c5-72c9-41d7-b848-3da3cbb55c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:42.917330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e9c5-72c9-41d7-b848-3da3cbb55c4b admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:42.917645 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e9c5-72c9-41d7-b848-3da3cbb55c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:42.917927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e9c5-72c9-41d7-b848-3da3cbb55c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:42.918775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e9c5-72c9-41d7-b848-3da3cbb55c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:42.920527 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e9c5-72c9-41d7-b848-3da3cbb55c4b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:42.946129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1036/2051] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:42 2022] POST /identity/v3/projects => generated 355 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:42.950325 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae6ef-d23d-4934-a633-94358af88fad None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:42.961446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae6ef-d23d-4934-a633-94358af88fad None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:43.014843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0caef-6e93-4763-9a70-6df1a0b7f2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:43.015508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0caef-6e93-4763-9a70-6df1a0b7f2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:43.015790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0caef-6e93-4763-9a70-6df1a0b7f2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:43.016066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0caef-6e93-4763-9a70-6df1a0b7f2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:43.016760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0caef-6e93-4763-9a70-6df1a0b7f2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:43.018702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0caef-6e93-4763-9a70-6df1a0b7f2f0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:43.037979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1016/2052] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:42 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:43.042162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e9c5-72c9-41d7-b848-3da3cbb55c4b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:43.052093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e9c5-72c9-41d7-b848-3da3cbb55c4b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:43.056604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e794-31a5-481d-8d83-e9b3fc4c5748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:43.057240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e794-31a5-481d-8d83-e9b3fc4c5748 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:43.057517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e794-31a5-481d-8d83-e9b3fc4c5748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:43.057822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e794-31a5-481d-8d83-e9b3fc4c5748 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:43.058536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e794-31a5-481d-8d83-e9b3fc4c5748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:43.060144 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e794-31a5-481d-8d83-e9b3fc4c5748 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:43.070665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1037/2053] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:43.074419 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0caef-6e93-4763-9a70-6df1a0b7f2f0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:43.084661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0caef-6e93-4763-9a70-6df1a0b7f2f0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:43.089457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c09afd-5383-4e82-a85c-316f79e1ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:43.090337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c09afd-5383-4e82-a85c-316f79e1ae11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:43.090613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c09afd-5383-4e82-a85c-316f79e1ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:43.090885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c09afd-5383-4e82-a85c-316f79e1ae11 admin admin] PATH_INFO: `/v3/projects/034f68e3668f44d0a169cb862f3e4739/users/f0e79fb84d3a4898af462f69339004c4/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:43.104987 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c09afd-5383-4e82-a85c-316f79e1ae11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=034f68e3668f44d0a169cb862f3e4739, user_id=f0e79fb84d3a4898af462f69339004c4, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:43.107598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c09afd-5383-4e82-a85c-316f79e1ae11 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:43.120131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1017/2054] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:43 2022] PUT /identity/v3/projects/034f68e3668f44d0a169cb862f3e4739/users/f0e79fb84d3a4898af462f69339004c4/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:43.124172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e794-31a5-481d-8d83-e9b3fc4c5748 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:43.134468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e794-31a5-481d-8d83-e9b3fc4c5748 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:43.189616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969823c-2bc9-400a-b066-c9349cdd8acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:43.190270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969823c-2bc9-400a-b066-c9349cdd8acd admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:43.190545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969823c-2bc9-400a-b066-c9349cdd8acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:43.190815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969823c-2bc9-400a-b066-c9349cdd8acd admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:43.191531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969823c-2bc9-400a-b066-c9349cdd8acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:43.194016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969823c-2bc9-400a-b066-c9349cdd8acd admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:43.203470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1038/2055] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:43.207616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c09afd-5383-4e82-a85c-316f79e1ae11 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:43.217705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c09afd-5383-4e82-a85c-316f79e1ae11 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:43.222939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54361-05a0-4c52-b0a0-9b24b04bbc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:43.223897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54361-05a0-4c52-b0a0-9b24b04bbc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:43.224174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54361-05a0-4c52-b0a0-9b24b04bbc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:43.224450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54361-05a0-4c52-b0a0-9b24b04bbc2c admin admin] PATH_INFO: `/v3/projects/034f68e3668f44d0a169cb862f3e4739/users/f0e79fb84d3a4898af462f69339004c4/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:43.226504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e54361-05a0-4c52-b0a0-9b24b04bbc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=034f68e3668f44d0a169cb862f3e4739, user_id=f0e79fb84d3a4898af462f69339004c4, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:43.229128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e54361-05a0-4c52-b0a0-9b24b04bbc2c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:43.239645 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1018/2056] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:43 2022] PUT /identity/v3/projects/034f68e3668f44d0a169cb862f3e4739/users/f0e79fb84d3a4898af462f69339004c4/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:43.249576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582231bd-1ace-44ec-bc87-6f8e871424cb None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:43.249907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582231bd-1ace-44ec-bc87-6f8e871424cb None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:43.250190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582231bd-1ace-44ec-bc87-6f8e871424cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:43.275901 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-582231bd-1ace-44ec-bc87-6f8e871424cb None None] MFA Rules not processed for user `f0e79fb84d3a4898af462f69339004c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:43.277102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-582231bd-1ace-44ec-bc87-6f8e871424cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:43.342332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1039/2057] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:43 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:43.353725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54361-05a0-4c52-b0a0-9b24b04bbc2c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:43.355840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-91e54361-05a0-4c52-b0a0-9b24b04bbc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:43.412188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54361-05a0-4c52-b0a0-9b24b04bbc2c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:43.416120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bed0a-6e7b-4509-be73-f20232e9908e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:43.416753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bed0a-6e7b-4509-be73-f20232e9908e service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:43.417035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bed0a-6e7b-4509-be73-f20232e9908e service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:43.417309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bed0a-6e7b-4509-be73-f20232e9908e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:43.426044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bed0a-6e7b-4509-be73-f20232e9908e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:43.428008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bed0a-6e7b-4509-be73-f20232e9908e service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:43.437267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1019/2058] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:43 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:43.507383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582231bd-1ace-44ec-bc87-6f8e871424cb None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:43.516737 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582231bd-1ace-44ec-bc87-6f8e871424cb None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:43.520394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d134b21-cab7-413a-9ea2-f496900f1729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:43.521027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134b21-cab7-413a-9ea2-f496900f1729 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:43.521309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134b21-cab7-413a-9ea2-f496900f1729 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:43.521619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134b21-cab7-413a-9ea2-f496900f1729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:43.579753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d134b21-cab7-413a-9ea2-f496900f1729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:43.581183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d134b21-cab7-413a-9ea2-f496900f1729 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:43.590043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1040/2059] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:43 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:50.499622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bed0a-6e7b-4509-be73-f20232e9908e service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:50.501033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-149bed0a-6e7b-4509-be73-f20232e9908e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:50.563117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bed0a-6e7b-4509-be73-f20232e9908e service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:50.567549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:50.568405 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:50.568690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:50.568960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] PATH_INFO: `/v3/users/ef5e9b90626c4991b3e6a6623f7b4148` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:50.570131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5e9b90626c4991b3e6a6623f7b4148)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:50.572483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:50.617613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5e9b90626c4991b3e6a6623f7b4148'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:50.632831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5e9b90626c4991b3e6a6623f7b4148'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:50.639257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5e9b90626c4991b3e6a6623f7b4148'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:50.639949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5e9b90626c4991b3e6a6623f7b4148'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:50.648003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5e9b90626c4991b3e6a6623f7b4148'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:50.653738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1020/2060] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:50 2022] DELETE /identity/v3/users/ef5e9b90626c4991b3e6a6623f7b4148 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:50.658171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86cf5d-ff13-4e47-ae50-464fa9845990 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:50.658679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86cf5d-ff13-4e47-ae50-464fa9845990 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:50.658777 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86cf5d-ff13-4e47-ae50-464fa9845990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:50.675200 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-8d86cf5d-ff13-4e47-ae50-464fa9845990 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:50.676498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8d86cf5d-ff13-4e47-ae50-464fa9845990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:50.735278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1041/2061] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:50.744755 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:50.746190 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:50.800822 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3ce46-92c0-4afb-b845-36b5b743ce43 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:50.804463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88140fe8-fd44-4987-8b0f-4a882bfc1227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:50.805093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88140fe8-fd44-4987-8b0f-4a882bfc1227 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:50.805375 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88140fe8-fd44-4987-8b0f-4a882bfc1227 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:50.805679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88140fe8-fd44-4987-8b0f-4a882bfc1227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:50.814445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88140fe8-fd44-4987-8b0f-4a882bfc1227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:50.815868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88140fe8-fd44-4987-8b0f-4a882bfc1227 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:50.825365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1021/2062] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:51.417131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86cf5d-ff13-4e47-ae50-464fa9845990 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:51.418678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8d86cf5d-ff13-4e47-ae50-464fa9845990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:51.452247 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86cf5d-ff13-4e47-ae50-464fa9845990 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:51.463042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:51.463920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.464205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.464537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] PATH_INFO: `/v3/projects/eaa15fce85124ffb9a12a722d7463bba` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:51.465827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa15fce85124ffb9a12a722d7463bba)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:51.467884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:51.522271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa15fce85124ffb9a12a722d7463bba', 'request_id': 'req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:51.530572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa15fce85124ffb9a12a722d7463bba', 'request_id': 'req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:51.538544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa15fce85124ffb9a12a722d7463bba', 'request_id': 'req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:51.549112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] The token cache is being invalidate because project eaa15fce85124ffb9a12a722d7463bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:00:51.549400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:51.550084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ce59cf6f-d564-49d7-b28d-6bed78d1fc11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:51.551617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1042/2063] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:51 2022] DELETE /identity/v3/projects/eaa15fce85124ffb9a12a722d7463bba => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:51.556990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44025c-a199-4f1c-a4ac-d35fb7351bdc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.557429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44025c-a199-4f1c-a4ac-d35fb7351bdc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.557586 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44025c-a199-4f1c-a4ac-d35fb7351bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:51.575018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ef44025c-a199-4f1c-a4ac-d35fb7351bdc None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:51.576219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ef44025c-a199-4f1c-a4ac-d35fb7351bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:51.632975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1022/2064] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:51.640650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6b00b-b60a-4c9b-aa86-580cfadf7153 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.640933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6b00b-b60a-4c9b-aa86-580cfadf7153 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.641208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6b00b-b60a-4c9b-aa86-580cfadf7153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:51.659198 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-48e6b00b-b60a-4c9b-aa86-580cfadf7153 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:51.660323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-48e6b00b-b60a-4c9b-aa86-580cfadf7153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:51.668857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1043/2065] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:51.672986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44025c-a199-4f1c-a4ac-d35fb7351bdc None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:51.682998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44025c-a199-4f1c-a4ac-d35fb7351bdc None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:51.687762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b60d2-2b40-4924-adb7-1bdcdc4990f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:51.688524 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b60d2-2b40-4924-adb7-1bdcdc4990f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.688860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b60d2-2b40-4924-adb7-1bdcdc4990f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.689288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b60d2-2b40-4924-adb7-1bdcdc4990f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:51.690311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b60d2-2b40-4924-adb7-1bdcdc4990f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:00:51.690654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b60d2-2b40-4924-adb7-1bdcdc4990f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:51.692483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b60d2-2b40-4924-adb7-1bdcdc4990f8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:51.708475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1023/2066] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:00:51.709542 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6b00b-b60a-4c9b-aa86-580cfadf7153 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:51.718641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6b00b-b60a-4c9b-aa86-580cfadf7153 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:51.723536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd20fae-c602-4d74-b838-ed355621a89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:51.724701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd20fae-c602-4d74-b838-ed355621a89a admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.724978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd20fae-c602-4d74-b838-ed355621a89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.725252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd20fae-c602-4d74-b838-ed355621a89a admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:51.726004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd20fae-c602-4d74-b838-ed355621a89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:51.728012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd20fae-c602-4d74-b838-ed355621a89a admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:51.757387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1044/2067] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:51 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:51.761409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b60d2-2b40-4924-adb7-1bdcdc4990f8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:51.772112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b60d2-2b40-4924-adb7-1bdcdc4990f8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:51.825573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bedcf2-f8ed-45ac-95de-6de0746657bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:51.826241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bedcf2-f8ed-45ac-95de-6de0746657bc admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.826529 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bedcf2-f8ed-45ac-95de-6de0746657bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.826803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bedcf2-f8ed-45ac-95de-6de0746657bc admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:51.827495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bedcf2-f8ed-45ac-95de-6de0746657bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:51.829512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bedcf2-f8ed-45ac-95de-6de0746657bc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:51.848908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1024/2068] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:51 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:51.853508 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd20fae-c602-4d74-b838-ed355621a89a admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:51.863539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd20fae-c602-4d74-b838-ed355621a89a admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:51.868210 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f408c6-961d-46e8-890f-deed4b6bcb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:51.868877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f408c6-961d-46e8-890f-deed4b6bcb5d admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.869157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f408c6-961d-46e8-890f-deed4b6bcb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.869428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f408c6-961d-46e8-890f-deed4b6bcb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:51.870177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f408c6-961d-46e8-890f-deed4b6bcb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:51.871776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f408c6-961d-46e8-890f-deed4b6bcb5d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:51.884876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1045/2069] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:51.886128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bedcf2-f8ed-45ac-95de-6de0746657bc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:51.896688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bedcf2-f8ed-45ac-95de-6de0746657bc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:51.902855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787c47b-69b0-4c01-8cf5-4f59ea1bd4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:51.903620 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787c47b-69b0-4c01-8cf5-4f59ea1bd4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.903989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787c47b-69b0-4c01-8cf5-4f59ea1bd4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.904274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787c47b-69b0-4c01-8cf5-4f59ea1bd4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:51.905131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787c47b-69b0-4c01-8cf5-4f59ea1bd4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:51.907030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787c47b-69b0-4c01-8cf5-4f59ea1bd4b1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:51.923329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1025/2070] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:51.924403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f408c6-961d-46e8-890f-deed4b6bcb5d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:51.934851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f408c6-961d-46e8-890f-deed4b6bcb5d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:51.939565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c7a9-dfba-459e-bbea-5df002225580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:51.940487 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c7a9-dfba-459e-bbea-5df002225580 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.940722 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c7a9-dfba-459e-bbea-5df002225580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.940998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c7a9-dfba-459e-bbea-5df002225580 admin admin] PATH_INFO: `/v3/projects/cfc1d4e7189a4f9fad5774b65bb247e2/users/7a600257b2f246bc828f29c13f763885/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:51.956191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74c7a9-dfba-459e-bbea-5df002225580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc1d4e7189a4f9fad5774b65bb247e2, user_id=7a600257b2f246bc828f29c13f763885, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:51.959439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74c7a9-dfba-459e-bbea-5df002225580 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:51.974820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1046/2071] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:51 2022] PUT /identity/v3/projects/cfc1d4e7189a4f9fad5774b65bb247e2/users/7a600257b2f246bc828f29c13f763885/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:51.985659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766184be-a324-42ec-a1dc-7b233d500a63 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:51.985958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766184be-a324-42ec-a1dc-7b233d500a63 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:51.986245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766184be-a324-42ec-a1dc-7b233d500a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.013811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-766184be-a324-42ec-a1dc-7b233d500a63 None None] MFA Rules not processed for user `7a600257b2f246bc828f29c13f763885`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:52.015032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-766184be-a324-42ec-a1dc-7b233d500a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:52.082537 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1026/2072] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:52.098929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c7a9-dfba-459e-bbea-5df002225580 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.191633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c7a9-dfba-459e-bbea-5df002225580 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.196779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66855b70-4541-4f96-aed8-23c2ffca36e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.197662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66855b70-4541-4f96-aed8-23c2ffca36e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.198297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66855b70-4541-4f96-aed8-23c2ffca36e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.198720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66855b70-4541-4f96-aed8-23c2ffca36e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.199554 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66855b70-4541-4f96-aed8-23c2ffca36e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.201617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66855b70-4541-4f96-aed8-23c2ffca36e6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.234034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1047/2073] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:52.238112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766184be-a324-42ec-a1dc-7b233d500a63 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.256976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766184be-a324-42ec-a1dc-7b233d500a63 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.326185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ee5bc-ca58-4b36-8914-ed9915030e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.326935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ee5bc-ca58-4b36-8914-ed9915030e6d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.327224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ee5bc-ca58-4b36-8914-ed9915030e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.327500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ee5bc-ca58-4b36-8914-ed9915030e6d admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.328183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ee5bc-ca58-4b36-8914-ed9915030e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.330138 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ee5bc-ca58-4b36-8914-ed9915030e6d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.353366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1027/2074] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:52 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:52.355070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66855b70-4541-4f96-aed8-23c2ffca36e6 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.367454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66855b70-4541-4f96-aed8-23c2ffca36e6 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.372287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c693-cef3-4181-8144-163017ea6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.373319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c693-cef3-4181-8144-163017ea6ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.373681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c693-cef3-4181-8144-163017ea6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.374048 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c693-cef3-4181-8144-163017ea6ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.374920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562c693-cef3-4181-8144-163017ea6ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.376790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562c693-cef3-4181-8144-163017ea6ed4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.388871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1048/2075] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:52.392594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ee5bc-ca58-4b36-8914-ed9915030e6d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.404606 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ee5bc-ca58-4b36-8914-ed9915030e6d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.417564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36c1f6-c9b0-443a-a5c0-11e6e648d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.417564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36c1f6-c9b0-443a-a5c0-11e6e648d19b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.417564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36c1f6-c9b0-443a-a5c0-11e6e648d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.417564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36c1f6-c9b0-443a-a5c0-11e6e648d19b admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.418612 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36c1f6-c9b0-443a-a5c0-11e6e648d19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.418612 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36c1f6-c9b0-443a-a5c0-11e6e648d19b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.426990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1028/2076] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:52.428064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c693-cef3-4181-8144-163017ea6ed4 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.438792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c693-cef3-4181-8144-163017ea6ed4 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.445113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baea9fa-be5c-445f-9504-c385e38b8a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.446191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baea9fa-be5c-445f-9504-c385e38b8a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.446478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baea9fa-be5c-445f-9504-c385e38b8a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.446758 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baea9fa-be5c-445f-9504-c385e38b8a5b admin admin] PATH_INFO: `/v3/projects/4a73f8b0142e4419877aa0e38a72b70a/users/052cba4159d54e02b1801d4bc18ae7c7/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.465627 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baea9fa-be5c-445f-9504-c385e38b8a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a73f8b0142e4419877aa0e38a72b70a, user_id=052cba4159d54e02b1801d4bc18ae7c7, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.468396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baea9fa-be5c-445f-9504-c385e38b8a5b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.487106 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1049/2077] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:52 2022] PUT /identity/v3/projects/4a73f8b0142e4419877aa0e38a72b70a/users/052cba4159d54e02b1801d4bc18ae7c7/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:00:52.497681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85451a-3490-49dd-9f8b-c27db3fe3c59 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.498432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85451a-3490-49dd-9f8b-c27db3fe3c59 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.500176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85451a-3490-49dd-9f8b-c27db3fe3c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.535330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fb85451a-3490-49dd-9f8b-c27db3fe3c59 None None] MFA Rules not processed for user `052cba4159d54e02b1801d4bc18ae7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:52.536687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fb85451a-3490-49dd-9f8b-c27db3fe3c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:52.599925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1029/2078] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:52.604609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baea9fa-be5c-445f-9504-c385e38b8a5b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.662277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baea9fa-be5c-445f-9504-c385e38b8a5b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.667390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b05b15-4ca6-4569-98ac-866fc1ae65c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.668057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b05b15-4ca6-4569-98ac-866fc1ae65c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.668331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b05b15-4ca6-4569-98ac-866fc1ae65c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.668602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b05b15-4ca6-4569-98ac-866fc1ae65c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.669299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b05b15-4ca6-4569-98ac-866fc1ae65c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.671232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b05b15-4ca6-4569-98ac-866fc1ae65c7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.701032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1050/2079] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:00:52.702248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85451a-3490-49dd-9f8b-c27db3fe3c59 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.713482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85451a-3490-49dd-9f8b-c27db3fe3c59 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.771101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4fa61-31a1-45a9-a28f-1e671e715244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.771782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4fa61-31a1-45a9-a28f-1e671e715244 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.772066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4fa61-31a1-45a9-a28f-1e671e715244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.772342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4fa61-31a1-45a9-a28f-1e671e715244 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.773048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4fa61-31a1-45a9-a28f-1e671e715244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.774996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4fa61-31a1-45a9-a28f-1e671e715244 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.794396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1030/2080] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:00:52 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:00:52.798469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b05b15-4ca6-4569-98ac-866fc1ae65c7 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.809256 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b05b15-4ca6-4569-98ac-866fc1ae65c7 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.813867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77a23e-0c99-4ce9-83ec-e7ded7fd0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.814514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77a23e-0c99-4ce9-83ec-e7ded7fd0ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.814796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77a23e-0c99-4ce9-83ec-e7ded7fd0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.815069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77a23e-0c99-4ce9-83ec-e7ded7fd0ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.815781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77a23e-0c99-4ce9-83ec-e7ded7fd0ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.817383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77a23e-0c99-4ce9-83ec-e7ded7fd0ab5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.828568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1051/2081] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:00:52.832714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4fa61-31a1-45a9-a28f-1e671e715244 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.842786 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4fa61-31a1-45a9-a28f-1e671e715244 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.847380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c7317-f2b9-4e98-a5b9-49dbc0f5ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.848256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c7317-f2b9-4e98-a5b9-49dbc0f5ca67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.848540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c7317-f2b9-4e98-a5b9-49dbc0f5ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.848821 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c7317-f2b9-4e98-a5b9-49dbc0f5ca67 admin admin] PATH_INFO: `/v3/projects/0910441a6b9c43f68bf81fa4a2e96904/users/01768f5b077e4f638aa32faa2b765677/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.862882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c7317-f2b9-4e98-a5b9-49dbc0f5ca67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0910441a6b9c43f68bf81fa4a2e96904, user_id=01768f5b077e4f638aa32faa2b765677, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.866070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c7317-f2b9-4e98-a5b9-49dbc0f5ca67 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.880127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1031/2082] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:52 2022] PUT /identity/v3/projects/0910441a6b9c43f68bf81fa4a2e96904/users/01768f5b077e4f638aa32faa2b765677/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:52.884703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77a23e-0c99-4ce9-83ec-e7ded7fd0ab5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.894317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77a23e-0c99-4ce9-83ec-e7ded7fd0ab5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.951830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49904a9a-5a56-4403-bcc5-0688532f182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.952433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49904a9a-5a56-4403-bcc5-0688532f182d admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.952717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49904a9a-5a56-4403-bcc5-0688532f182d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.952993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49904a9a-5a56-4403-bcc5-0688532f182d admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.953753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49904a9a-5a56-4403-bcc5-0688532f182d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.955348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49904a9a-5a56-4403-bcc5-0688532f182d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:52.965245 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1052/2083] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:00:52.969377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c7317-f2b9-4e98-a5b9-49dbc0f5ca67 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:52.980270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c7317-f2b9-4e98-a5b9-49dbc0f5ca67 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:52.984826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ab21f-6df0-4ff9-b1e4-9e144db0705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:52.985736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ab21f-6df0-4ff9-b1e4-9e144db0705e admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:52.986019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ab21f-6df0-4ff9-b1e4-9e144db0705e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:52.986293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ab21f-6df0-4ff9-b1e4-9e144db0705e admin admin] PATH_INFO: `/v3/projects/0910441a6b9c43f68bf81fa4a2e96904/users/01768f5b077e4f638aa32faa2b765677/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:52.988283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ab21f-6df0-4ff9-b1e4-9e144db0705e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0910441a6b9c43f68bf81fa4a2e96904, user_id=01768f5b077e4f638aa32faa2b765677, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:52.991634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ab21f-6df0-4ff9-b1e4-9e144db0705e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:53.002113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1032/2084] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:00:52 2022] PUT /identity/v3/projects/0910441a6b9c43f68bf81fa4a2e96904/users/01768f5b077e4f638aa32faa2b765677/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:53.013026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63874b78-3396-4ed9-9f82-cc8b3929536c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:53.013318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63874b78-3396-4ed9-9f82-cc8b3929536c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:53.013673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63874b78-3396-4ed9-9f82-cc8b3929536c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:53.041396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-63874b78-3396-4ed9-9f82-cc8b3929536c None None] MFA Rules not processed for user `01768f5b077e4f638aa32faa2b765677`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:53.042698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-63874b78-3396-4ed9-9f82-cc8b3929536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:53.112552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1053/2085] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:00:53.124432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ab21f-6df0-4ff9-b1e4-9e144db0705e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:53.126197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c18ab21f-6df0-4ff9-b1e4-9e144db0705e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:53.184760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ab21f-6df0-4ff9-b1e4-9e144db0705e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:53.188901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde03629-0137-4752-8747-4ed095c3d245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:53.189626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde03629-0137-4752-8747-4ed095c3d245 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:53.189913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde03629-0137-4752-8747-4ed095c3d245 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:53.190188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde03629-0137-4752-8747-4ed095c3d245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:53.246852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde03629-0137-4752-8747-4ed095c3d245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:53.248204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde03629-0137-4752-8747-4ed095c3d245 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:53.256966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1033/2086] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:54.742057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63874b78-3396-4ed9-9f82-cc8b3929536c None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:54.751405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63874b78-3396-4ed9-9f82-cc8b3929536c None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:54.754899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5b612-3a90-4fda-9a95-90f27b2e918f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:54.755529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5b612-3a90-4fda-9a95-90f27b2e918f service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:54.755811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5b612-3a90-4fda-9a95-90f27b2e918f service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:54.756085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5b612-3a90-4fda-9a95-90f27b2e918f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:54.813576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5b612-3a90-4fda-9a95-90f27b2e918f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:54.815034 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5b612-3a90-4fda-9a95-90f27b2e918f service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:54.824341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1054/2087] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:55.411480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde03629-0137-4752-8747-4ed095c3d245 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:55.412993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dde03629-0137-4752-8747-4ed095c3d245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:55.424302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde03629-0137-4752-8747-4ed095c3d245 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:55.427829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a8709-1d6d-419e-b313-3350b8fb5a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:55.428453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8709-1d6d-419e-b313-3350b8fb5a74 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:55.428733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8709-1d6d-419e-b313-3350b8fb5a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:55.429007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8709-1d6d-419e-b313-3350b8fb5a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:55.437628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8709-1d6d-419e-b313-3350b8fb5a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:55.439020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8709-1d6d-419e-b313-3350b8fb5a74 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:55.448720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1034/2088] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:59.301077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5b612-3a90-4fda-9a95-90f27b2e918f service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:59.359754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5b612-3a90-4fda-9a95-90f27b2e918f service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:59.364094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:59.365461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:59.365764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:59.366029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] PATH_INFO: `/v3/users/7a600257b2f246bc828f29c13f763885` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:59.367220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a600257b2f246bc828f29c13f763885)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:59.369108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:59.416301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a600257b2f246bc828f29c13f763885'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:59.416874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a600257b2f246bc828f29c13f763885'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:59.428731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a600257b2f246bc828f29c13f763885'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:59.429356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a600257b2f246bc828f29c13f763885'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:59.436557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a600257b2f246bc828f29c13f763885'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:59.448932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1055/2089] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:00:59 2022] DELETE /identity/v3/users/7a600257b2f246bc828f29c13f763885 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:00:59.453833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75177a-94ab-4dd0-b61f-22c2092e4061 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:59.454336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75177a-94ab-4dd0-b61f-22c2092e4061 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:59.454432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75177a-94ab-4dd0-b61f-22c2092e4061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:59.472092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4f75177a-94ab-4dd0-b61f-22c2092e4061 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:00:59.473291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4f75177a-94ab-4dd0-b61f-22c2092e4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:59.530979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1035/2090] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:00:59.541049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:59.542486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:59.597871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b0531-038e-4267-b697-fa1cd5d1234f admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:59.601910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1684f87-56e1-4b51-b085-5f405481014a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:59.602538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1684f87-56e1-4b51-b085-5f405481014a service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:59.602817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1684f87-56e1-4b51-b085-5f405481014a service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:59.603118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1684f87-56e1-4b51-b085-5f405481014a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:59.612489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1684f87-56e1-4b51-b085-5f405481014a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:59.613937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1684f87-56e1-4b51-b085-5f405481014a service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:59.624499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1056/2091] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:00:59.899222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75177a-94ab-4dd0-b61f-22c2092e4061 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:00:59.900796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4f75177a-94ab-4dd0-b61f-22c2092e4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:00:59.913115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75177a-94ab-4dd0-b61f-22c2092e4061 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:00:59.918407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:00:59.919320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:00:59.919555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:00:59.919832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] PATH_INFO: `/v3/projects/cfc1d4e7189a4f9fad5774b65bb247e2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:00:59.921486 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc1d4e7189a4f9fad5774b65bb247e2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:00:59.923421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:00:59.969040 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc1d4e7189a4f9fad5774b65bb247e2', 'request_id': 'req-460c1f07-eeda-4905-8b93-35cf499ea15c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:59.976194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc1d4e7189a4f9fad5774b65bb247e2', 'request_id': 'req-460c1f07-eeda-4905-8b93-35cf499ea15c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:00:59.983793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc1d4e7189a4f9fad5774b65bb247e2', 'request_id': 'req-460c1f07-eeda-4905-8b93-35cf499ea15c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.001637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] The token cache is being invalidate because project cfc1d4e7189a4f9fad5774b65bb247e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:00.001922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.002559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.004125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1036/2092] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:00:59 2022] DELETE /identity/v3/projects/cfc1d4e7189a4f9fad5774b65bb247e2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:00.008554 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1684f87-56e1-4b51-b085-5f405481014a service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:00.018455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1684f87-56e1-4b51-b085-5f405481014a service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:00.073922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:00.075064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:00.075529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:00.075863 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] PATH_INFO: `/v3/users/052cba4159d54e02b1801d4bc18ae7c7` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:00.077172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=052cba4159d54e02b1801d4bc18ae7c7)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:00.079431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:00.126586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052cba4159d54e02b1801d4bc18ae7c7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.127158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052cba4159d54e02b1801d4bc18ae7c7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.138908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052cba4159d54e02b1801d4bc18ae7c7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.139753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052cba4159d54e02b1801d4bc18ae7c7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.147325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052cba4159d54e02b1801d4bc18ae7c7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.161149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1057/2093] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:00 2022] DELETE /identity/v3/users/052cba4159d54e02b1801d4bc18ae7c7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:00.460916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:00.462572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:00.475312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c1f07-eeda-4905-8b93-35cf499ea15c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:00.535195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:00.536223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:00.536542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:00.536882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] PATH_INFO: `/v3/users/17e52a1316884d408797883ae2d01689` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:00.538224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e52a1316884d408797883ae2d01689)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:00.540722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:00.548382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:00.551900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:00.565853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501b308-043d-445f-aba1-674fb7e01681 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:00.571417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:00.572324 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:00.572628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:00.572921 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] PATH_INFO: `/v3/projects/4a73f8b0142e4419877aa0e38a72b70a` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:00.574164 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a73f8b0142e4419877aa0e38a72b70a)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:00.576073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:00.595792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e52a1316884d408797883ae2d01689'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.607930 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e52a1316884d408797883ae2d01689'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.615070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e52a1316884d408797883ae2d01689'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.615770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e52a1316884d408797883ae2d01689'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.623274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e03b5d54-204b-44f9-8c4b-ea30545cb82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e52a1316884d408797883ae2d01689'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.627828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a73f8b0142e4419877aa0e38a72b70a', 'request_id': 'req-5c49e63a-2bbe-4801-8802-f02f90af3617'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.629426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1037/2094] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:00 2022] DELETE /identity/v3/users/17e52a1316884d408797883ae2d01689 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:00.634390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3270b3-45a7-4e36-aee1-5bbd5d4e6631 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:00.634682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3270b3-45a7-4e36-aee1-5bbd5d4e6631 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:00.634966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3270b3-45a7-4e36-aee1-5bbd5d4e6631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:00.635781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a73f8b0142e4419877aa0e38a72b70a', 'request_id': 'req-5c49e63a-2bbe-4801-8802-f02f90af3617'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.642649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a73f8b0142e4419877aa0e38a72b70a', 'request_id': 'req-5c49e63a-2bbe-4801-8802-f02f90af3617'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.652645 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0f3270b3-45a7-4e36-aee1-5bbd5d4e6631 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:00.653422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] The token cache is being invalidate because project 4a73f8b0142e4419877aa0e38a72b70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:00.653746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.653890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0f3270b3-45a7-4e36-aee1-5bbd5d4e6631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:00.654388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.656351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1058/2095] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:00 2022] DELETE /identity/v3/projects/4a73f8b0142e4419877aa0e38a72b70a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:00.660521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:00.661970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:00.715217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1038/2096] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:01:00.724759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3270b3-45a7-4e36-aee1-5bbd5d4e6631 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:00.726435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0f3270b3-45a7-4e36-aee1-5bbd5d4e6631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:00.727559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49e63a-2bbe-4801-8802-f02f90af3617 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:00.732822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:00.733736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:00.734021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:00.734297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] PATH_INFO: `/v3/users/01768f5b077e4f638aa32faa2b765677` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:00.735507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01768f5b077e4f638aa32faa2b765677)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:00.737423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:00.786115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01768f5b077e4f638aa32faa2b765677'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.786610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3270b3-45a7-4e36-aee1-5bbd5d4e6631 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:00.786775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01768f5b077e4f638aa32faa2b765677'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.790670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493248d-bcb8-4e4c-9b9c-ed70c94edb52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:00.791359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493248d-bcb8-4e4c-9b9c-ed70c94edb52 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:00.791711 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493248d-bcb8-4e4c-9b9c-ed70c94edb52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:00.791985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493248d-bcb8-4e4c-9b9c-ed70c94edb52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:00.798932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01768f5b077e4f638aa32faa2b765677'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.799658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01768f5b077e4f638aa32faa2b765677'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.801331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493248d-bcb8-4e4c-9b9c-ed70c94edb52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:00.803587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493248d-bcb8-4e4c-9b9c-ed70c94edb52 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:00.812282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01768f5b077e4f638aa32faa2b765677'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:00.815406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1039/2097] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:01:00.830613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1059/2098] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:00 2022] DELETE /identity/v3/users/01768f5b077e4f638aa32faa2b765677 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:01:01.120271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493248d-bcb8-4e4c-9b9c-ed70c94edb52 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.137683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b493248d-bcb8-4e4c-9b9c-ed70c94edb52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:01.138510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.138510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:01.147104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493248d-bcb8-4e4c-9b9c-ed70c94edb52 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.209942 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884c901-cea8-4223-98d1-5546b8ca7626 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.214856 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.215781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.216125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.216404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] PATH_INFO: `/v3/projects/0910441a6b9c43f68bf81fa4a2e96904` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.217578 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0910441a6b9c43f68bf81fa4a2e96904)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.219478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.220440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.221308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.221623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.221904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] PATH_INFO: `/v3/projects/510aa5d1418b469281b53db7eaccf1d4` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.223077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510aa5d1418b469281b53db7eaccf1d4)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.225778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.270583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0910441a6b9c43f68bf81fa4a2e96904', 'request_id': 'req-e10545f5-6f37-454b-8a11-71a358fbe3ef'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.271499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510aa5d1418b469281b53db7eaccf1d4', 'request_id': 'req-faba12af-3050-445f-8863-6693b5bad862'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.278211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0910441a6b9c43f68bf81fa4a2e96904', 'request_id': 'req-e10545f5-6f37-454b-8a11-71a358fbe3ef'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.279994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510aa5d1418b469281b53db7eaccf1d4', 'request_id': 'req-faba12af-3050-445f-8863-6693b5bad862'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.285409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0910441a6b9c43f68bf81fa4a2e96904', 'request_id': 'req-e10545f5-6f37-454b-8a11-71a358fbe3ef'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.285677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510aa5d1418b469281b53db7eaccf1d4', 'request_id': 'req-faba12af-3050-445f-8863-6693b5bad862'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.296589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] The token cache is being invalidate because project 0910441a6b9c43f68bf81fa4a2e96904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:01.296957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.297335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] The token cache is being invalidate because project 510aa5d1418b469281b53db7eaccf1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:01.297640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e10545f5-6f37-454b-8a11-71a358fbe3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.297738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.298326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.299916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1040/2099] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:01 2022] DELETE /identity/v3/projects/510aa5d1418b469281b53db7eaccf1d4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:01.303745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1060/2100] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:01 2022] DELETE /identity/v3/projects/0910441a6b9c43f68bf81fa4a2e96904 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:01:01.304598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.305999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:01.308825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363498ce-379b-4450-8952-52db7ac98d6d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.309197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363498ce-379b-4450-8952-52db7ac98d6d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.309484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363498ce-379b-4450-8952-52db7ac98d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.327897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-363498ce-379b-4450-8952-52db7ac98d6d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:01.329112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-363498ce-379b-4450-8952-52db7ac98d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:01.375038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba12af-3050-445f-8863-6693b5bad862 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.380434 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.381373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.381691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.381969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] PATH_INFO: `/v3/users/f0e79fb84d3a4898af462f69339004c4` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.383164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e79fb84d3a4898af462f69339004c4)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.385084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.395211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1061/2101] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:01.402829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64295b9-975d-483d-949f-5ed8fbc5eb64 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.403116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64295b9-975d-483d-949f-5ed8fbc5eb64 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.403388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64295b9-975d-483d-949f-5ed8fbc5eb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.423576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b64295b9-975d-483d-949f-5ed8fbc5eb64 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:01.424771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b64295b9-975d-483d-949f-5ed8fbc5eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:01.433849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1062/2102] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:01:01.434674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e79fb84d3a4898af462f69339004c4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.437822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64295b9-975d-483d-949f-5ed8fbc5eb64 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.447302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e79fb84d3a4898af462f69339004c4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.448159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64295b9-975d-483d-949f-5ed8fbc5eb64 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.452728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.453375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.453691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.453960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.454287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e79fb84d3a4898af462f69339004c4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.454706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:01:01.454983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e79fb84d3a4898af462f69339004c4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.455087 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.456576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.462377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e79fb84d3a4898af462f69339004c4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.472134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1063/2103] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:01:01.472286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1041/2104] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:01 2022] DELETE /identity/v3/users/f0e79fb84d3a4898af462f69339004c4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:01.473439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.475807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:01.488812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc522d0-4834-45d4-b867-751326cc580f admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.546858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908e73-c2bc-4fc7-8fd7-73dbfc36d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.547560 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908e73-c2bc-4fc7-8fd7-73dbfc36d7dd admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.547850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908e73-c2bc-4fc7-8fd7-73dbfc36d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.548127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908e73-c2bc-4fc7-8fd7-73dbfc36d7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.548841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a908e73-c2bc-4fc7-8fd7-73dbfc36d7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.551075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a908e73-c2bc-4fc7-8fd7-73dbfc36d7dd admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.581649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1064/2105] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:01:01 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:01:01.586495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.596581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787c07-06dd-4b61-9d89-58358d28e68e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.657984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd69c-8fcd-412f-ac54-7f4cf0c3538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.658659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd69c-8fcd-412f-ac54-7f4cf0c3538f admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.658938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd69c-8fcd-412f-ac54-7f4cf0c3538f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.659213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd69c-8fcd-412f-ac54-7f4cf0c3538f admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.659909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88dd69c-8fcd-412f-ac54-7f4cf0c3538f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.662461 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88dd69c-8fcd-412f-ac54-7f4cf0c3538f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.695070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1042/2106] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:01:01 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:01.696861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908e73-c2bc-4fc7-8fd7-73dbfc36d7dd admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.709159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908e73-c2bc-4fc7-8fd7-73dbfc36d7dd admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.715111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ed13c-40e2-4607-abc0-9075adc895f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.716136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ed13c-40e2-4607-abc0-9075adc895f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.721199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ed13c-40e2-4607-abc0-9075adc895f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.721510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ed13c-40e2-4607-abc0-9075adc895f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.722444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ed13c-40e2-4607-abc0-9075adc895f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.724835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ed13c-40e2-4607-abc0-9075adc895f4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.738471 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1065/2107] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:01.742721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd69c-8fcd-412f-ac54-7f4cf0c3538f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.753133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd69c-8fcd-412f-ac54-7f4cf0c3538f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.758062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6e6a-d392-4c99-9efa-b137643fe599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.758734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6e6a-d392-4c99-9efa-b137643fe599 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.759019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6e6a-d392-4c99-9efa-b137643fe599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.759299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6e6a-d392-4c99-9efa-b137643fe599 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.760036 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd6e6a-d392-4c99-9efa-b137643fe599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.761848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd6e6a-d392-4c99-9efa-b137643fe599 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.772832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1043/2108] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:01.776745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ed13c-40e2-4607-abc0-9075adc895f4 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.787448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ed13c-40e2-4607-abc0-9075adc895f4 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.793832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e2e5b-6236-4d15-9c9c-59cf87bea02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.794908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e2e5b-6236-4d15-9c9c-59cf87bea02f admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.795185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e2e5b-6236-4d15-9c9c-59cf87bea02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.795452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e2e5b-6236-4d15-9c9c-59cf87bea02f admin admin] PATH_INFO: `/v3/projects/97dda6e8bb014ca09e89d1f29ea6079d/users/055b805a747746a19c57cd06c39396df/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.811976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e2e5b-6236-4d15-9c9c-59cf87bea02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dda6e8bb014ca09e89d1f29ea6079d, user_id=055b805a747746a19c57cd06c39396df, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.815444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e2e5b-6236-4d15-9c9c-59cf87bea02f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.821911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6e6a-d392-4c99-9efa-b137643fe599 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.823739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-abfd6e6a-d392-4c99-9efa-b137643fe599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:01.833937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1066/2109] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:01 2022] PUT /identity/v3/projects/97dda6e8bb014ca09e89d1f29ea6079d/users/055b805a747746a19c57cd06c39396df/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:01.838685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6e6a-d392-4c99-9efa-b137643fe599 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:01.845061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8ea2e-00fd-4484-8f83-03a50c9ab153 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.845357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8ea2e-00fd-4484-8f83-03a50c9ab153 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.845660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8ea2e-00fd-4484-8f83-03a50c9ab153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.872649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b9c8ea2e-00fd-4484-8f83-03a50c9ab153 None None] MFA Rules not processed for user `055b805a747746a19c57cd06c39396df`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:01.873905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b9c8ea2e-00fd-4484-8f83-03a50c9ab153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:01.898761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:01.899649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.900160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.900287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] PATH_INFO: `/v3/projects/034f68e3668f44d0a169cb862f3e4739` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:01.901403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] RBAC: Authorizing `identity:delete_project(project_id=034f68e3668f44d0a169cb862f3e4739)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:01.903482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:01.944297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1067/2110] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:01.953294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034f68e3668f44d0a169cb862f3e4739', 'request_id': 'req-b8e3f21d-fa91-40db-84d4-196ddf02007f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.955599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8ea2e-00fd-4484-8f83-03a50c9ab153 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:01.957036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b9c8ea2e-00fd-4484-8f83-03a50c9ab153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:01.963361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034f68e3668f44d0a169cb862f3e4739', 'request_id': 'req-b8e3f21d-fa91-40db-84d4-196ddf02007f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.969694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034f68e3668f44d0a169cb862f3e4739', 'request_id': 'req-b8e3f21d-fa91-40db-84d4-196ddf02007f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.982865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] The token cache is being invalidate because project 034f68e3668f44d0a169cb862f3e4739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:01.983150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.983812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b8e3f21d-fa91-40db-84d4-196ddf02007f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:01.985360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1044/2111] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:01 2022] DELETE /identity/v3/projects/034f68e3668f44d0a169cb862f3e4739 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:01:01.990124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45079d01-c2eb-49bc-b296-9b1b65c2ddf5 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:01.990406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45079d01-c2eb-49bc-b296-9b1b65c2ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:01.990681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45079d01-c2eb-49bc-b296-9b1b65c2ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.009382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-45079d01-c2eb-49bc-b296-9b1b65c2ddf5 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:02.010801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-45079d01-c2eb-49bc-b296-9b1b65c2ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:02.017681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8ea2e-00fd-4484-8f83-03a50c9ab153 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.068956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26788337-8719-4ab7-9cbe-b450b6b206a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.069634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26788337-8719-4ab7-9cbe-b450b6b206a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.069922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26788337-8719-4ab7-9cbe-b450b6b206a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.070012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1045/2112] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:01:02.070260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26788337-8719-4ab7-9cbe-b450b6b206a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.071971 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-26788337-8719-4ab7-9cbe-b450b6b206a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:02.077691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fdee5-5727-41f2-b90a-abb5828a6072 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.077984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fdee5-5727-41f2-b90a-abb5828a6072 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.078262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fdee5-5727-41f2-b90a-abb5828a6072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.096577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6c6fdee5-5727-41f2-b90a-abb5828a6072 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:02.097833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6c6fdee5-5727-41f2-b90a-abb5828a6072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:02.105864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1046/2113] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:01:02.109943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fdee5-5727-41f2-b90a-abb5828a6072 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.118874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fdee5-5727-41f2-b90a-abb5828a6072 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.127536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790aea6-914e-4f20-8f90-7aa2927ebc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.128363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790aea6-914e-4f20-8f90-7aa2927ebc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.128764 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790aea6-914e-4f20-8f90-7aa2927ebc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.129149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790aea6-914e-4f20-8f90-7aa2927ebc7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.130555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790aea6-914e-4f20-8f90-7aa2927ebc7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:01:02.130966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790aea6-914e-4f20-8f90-7aa2927ebc7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.131144 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26788337-8719-4ab7-9cbe-b450b6b206a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.132594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26788337-8719-4ab7-9cbe-b450b6b206a5 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.132892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790aea6-914e-4f20-8f90-7aa2927ebc7f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.142148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1068/2114] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:01:02.145414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1047/2115] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:01:02.150434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26788337-8719-4ab7-9cbe-b450b6b206a5 service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.160890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26788337-8719-4ab7-9cbe-b450b6b206a5 service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.166216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291ee4e-8ef1-4196-b937-f887a958f00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.166881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291ee4e-8ef1-4196-b937-f887a958f00c admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.167186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291ee4e-8ef1-4196-b937-f887a958f00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.167464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291ee4e-8ef1-4196-b937-f887a958f00c admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.168155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291ee4e-8ef1-4196-b937-f887a958f00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.170121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291ee4e-8ef1-4196-b937-f887a958f00c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.199218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1069/2116] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:01:02 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:01:02.200309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790aea6-914e-4f20-8f90-7aa2927ebc7f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.212456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790aea6-914e-4f20-8f90-7aa2927ebc7f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.279202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc06f6-212e-46d0-995d-91f9531a454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.279878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc06f6-212e-46d0-995d-91f9531a454e admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.280217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc06f6-212e-46d0-995d-91f9531a454e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.280445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc06f6-212e-46d0-995d-91f9531a454e admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.281101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc06f6-212e-46d0-995d-91f9531a454e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.283056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc06f6-212e-46d0-995d-91f9531a454e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.306801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1048/2117] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:01:02 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:02.308305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291ee4e-8ef1-4196-b937-f887a958f00c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.318870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291ee4e-8ef1-4196-b937-f887a958f00c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.323732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151e099-23d3-4d17-8322-342c4c0f4e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.324392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151e099-23d3-4d17-8322-342c4c0f4e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.324669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151e099-23d3-4d17-8322-342c4c0f4e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.324947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151e099-23d3-4d17-8322-342c4c0f4e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.325699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151e099-23d3-4d17-8322-342c4c0f4e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.327335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151e099-23d3-4d17-8322-342c4c0f4e35 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.341470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1070/2118] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:02.342843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc06f6-212e-46d0-995d-91f9531a454e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.355604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc06f6-212e-46d0-995d-91f9531a454e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.361431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3febb27-efca-4fb4-89ee-b1bedafbd738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.362119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3febb27-efca-4fb4-89ee-b1bedafbd738 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.362448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3febb27-efca-4fb4-89ee-b1bedafbd738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.362910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3febb27-efca-4fb4-89ee-b1bedafbd738 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.364097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3febb27-efca-4fb4-89ee-b1bedafbd738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.365983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3febb27-efca-4fb4-89ee-b1bedafbd738 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.376251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1049/2119] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:02.380532 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151e099-23d3-4d17-8322-342c4c0f4e35 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.390770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151e099-23d3-4d17-8322-342c4c0f4e35 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.396038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bb30c-a002-4417-98e2-22b984e91443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.397201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bb30c-a002-4417-98e2-22b984e91443 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.397414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bb30c-a002-4417-98e2-22b984e91443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.397658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bb30c-a002-4417-98e2-22b984e91443 admin admin] PATH_INFO: `/v3/projects/758bc1ea92914ce08baa9f82fb7cbeb1/users/f81df7b879e84eb289f352e9d18f012c/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.419717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bb30c-a002-4417-98e2-22b984e91443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758bc1ea92914ce08baa9f82fb7cbeb1, user_id=f81df7b879e84eb289f352e9d18f012c, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.422430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bb30c-a002-4417-98e2-22b984e91443 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.436651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1071/2120] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:02 2022] PUT /identity/v3/projects/758bc1ea92914ce08baa9f82fb7cbeb1/users/f81df7b879e84eb289f352e9d18f012c/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:02.447991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e11ec0-b21f-4799-9146-9693e327a102 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.448237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e11ec0-b21f-4799-9146-9693e327a102 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.448639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e11ec0-b21f-4799-9146-9693e327a102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.476088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-60e11ec0-b21f-4799-9146-9693e327a102 None None] MFA Rules not processed for user `f81df7b879e84eb289f352e9d18f012c`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:02.477306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-60e11ec0-b21f-4799-9146-9693e327a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:02.544334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1050/2121] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:02.548965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bb30c-a002-4417-98e2-22b984e91443 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.610064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bb30c-a002-4417-98e2-22b984e91443 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.614748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c40c6b-c85e-4ac2-991b-6b89b15749b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.615399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40c6b-c85e-4ac2-991b-6b89b15749b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.615685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40c6b-c85e-4ac2-991b-6b89b15749b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.615957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40c6b-c85e-4ac2-991b-6b89b15749b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.616649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c40c6b-c85e-4ac2-991b-6b89b15749b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.618605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c40c6b-c85e-4ac2-991b-6b89b15749b4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.642297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1072/2122] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:01:02 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:02.646913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e11ec0-b21f-4799-9146-9693e327a102 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.657166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e11ec0-b21f-4799-9146-9693e327a102 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.712072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd194e3d-42b9-418f-a8e6-9428011e020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.712710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd194e3d-42b9-418f-a8e6-9428011e020e admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.712991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd194e3d-42b9-418f-a8e6-9428011e020e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.713279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd194e3d-42b9-418f-a8e6-9428011e020e admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.713975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd194e3d-42b9-418f-a8e6-9428011e020e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.715868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd194e3d-42b9-418f-a8e6-9428011e020e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.734253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1051/2123] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:01:02 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:02.738272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c40c6b-c85e-4ac2-991b-6b89b15749b4 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.748929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c40c6b-c85e-4ac2-991b-6b89b15749b4 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.753583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bab18-2a36-45db-aed5-eb7b26269f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.754194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bab18-2a36-45db-aed5-eb7b26269f70 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.754477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bab18-2a36-45db-aed5-eb7b26269f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.755301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bab18-2a36-45db-aed5-eb7b26269f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.755999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bab18-2a36-45db-aed5-eb7b26269f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.757735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bab18-2a36-45db-aed5-eb7b26269f70 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.769419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1073/2124] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:02.774503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd194e3d-42b9-418f-a8e6-9428011e020e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.784540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd194e3d-42b9-418f-a8e6-9428011e020e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.789123 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75a396-2fff-4772-bdf5-67608dfebf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.790291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a396-2fff-4772-bdf5-67608dfebf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.790572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a396-2fff-4772-bdf5-67608dfebf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.790844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a396-2fff-4772-bdf5-67608dfebf4a admin admin] PATH_INFO: `/v3/projects/fa1258b535554ef79ed825dba01a55d9/users/ac462da08f72487a94ac1746529c32b6/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.805510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75a396-2fff-4772-bdf5-67608dfebf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1258b535554ef79ed825dba01a55d9, user_id=ac462da08f72487a94ac1746529c32b6, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.808332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75a396-2fff-4772-bdf5-67608dfebf4a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.826155 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1052/2125] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:02 2022] PUT /identity/v3/projects/fa1258b535554ef79ed825dba01a55d9/users/ac462da08f72487a94ac1746529c32b6/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:02.827900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bab18-2a36-45db-aed5-eb7b26269f70 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.840821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bab18-2a36-45db-aed5-eb7b26269f70 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.901723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11ec0e-3725-4a9a-bf30-21c323509a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.902403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ec0e-3725-4a9a-bf30-21c323509a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.902677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ec0e-3725-4a9a-bf30-21c323509a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.902952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ec0e-3725-4a9a-bf30-21c323509a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.903675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11ec0e-3725-4a9a-bf30-21c323509a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.905284 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11ec0e-3725-4a9a-bf30-21c323509a73 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.915782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1074/2126] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:02.919997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75a396-2fff-4772-bdf5-67608dfebf4a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:02.930746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75a396-2fff-4772-bdf5-67608dfebf4a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:02.936395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f12d-a1d3-4651-98a8-827a18cdcef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:02.937260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f12d-a1d3-4651-98a8-827a18cdcef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.937563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f12d-a1d3-4651-98a8-827a18cdcef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.937845 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f12d-a1d3-4651-98a8-827a18cdcef2 admin admin] PATH_INFO: `/v3/projects/fa1258b535554ef79ed825dba01a55d9/users/ac462da08f72487a94ac1746529c32b6/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.939771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3f12d-a1d3-4651-98a8-827a18cdcef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1258b535554ef79ed825dba01a55d9, user_id=ac462da08f72487a94ac1746529c32b6, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:02.943093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3f12d-a1d3-4651-98a8-827a18cdcef2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:02.953355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1053/2127] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:02 2022] PUT /identity/v3/projects/fa1258b535554ef79ed825dba01a55d9/users/ac462da08f72487a94ac1746529c32b6/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:02.964065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed96012-7cd9-4931-8d47-d51a3cc26e32 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:02.964290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed96012-7cd9-4931-8d47-d51a3cc26e32 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:02.964598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed96012-7cd9-4931-8d47-d51a3cc26e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:02.991239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9ed96012-7cd9-4931-8d47-d51a3cc26e32 None None] MFA Rules not processed for user `ac462da08f72487a94ac1746529c32b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:02.992458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9ed96012-7cd9-4931-8d47-d51a3cc26e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:03.065882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1075/2128] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:03.079057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f12d-a1d3-4651-98a8-827a18cdcef2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:03.080730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-daf3f12d-a1d3-4651-98a8-827a18cdcef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:03.142265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f12d-a1d3-4651-98a8-827a18cdcef2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:03.145981 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980ef35-5622-4955-a211-e1a56052ccf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:03.146615 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980ef35-5622-4955-a211-e1a56052ccf7 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:03.146894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980ef35-5622-4955-a211-e1a56052ccf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:03.147191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980ef35-5622-4955-a211-e1a56052ccf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:03.156354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980ef35-5622-4955-a211-e1a56052ccf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:03.157853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980ef35-5622-4955-a211-e1a56052ccf7 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:03.168574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1054/2129] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:01:03.240049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed96012-7cd9-4931-8d47-d51a3cc26e32 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:03.249946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed96012-7cd9-4931-8d47-d51a3cc26e32 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:03.253541 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b5b21-05f0-4b72-8748-6e399e59cdab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:03.254208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b5b21-05f0-4b72-8748-6e399e59cdab service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:03.254495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b5b21-05f0-4b72-8748-6e399e59cdab service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:03.254767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b5b21-05f0-4b72-8748-6e399e59cdab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:03.311349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b5b21-05f0-4b72-8748-6e399e59cdab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:03.312785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b5b21-05f0-4b72-8748-6e399e59cdab service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:03.321911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1076/2130] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:01:23.155236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980ef35-5622-4955-a211-e1a56052ccf7 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:23.215320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980ef35-5622-4955-a211-e1a56052ccf7 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:23.219725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:23.220583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:23.220867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:23.221146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] PATH_INFO: `/v3/users/f81df7b879e84eb289f352e9d18f012c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:23.222360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81df7b879e84eb289f352e9d18f012c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:23.224304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:23.267607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81df7b879e84eb289f352e9d18f012c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.279088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81df7b879e84eb289f352e9d18f012c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.285581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81df7b879e84eb289f352e9d18f012c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.286243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81df7b879e84eb289f352e9d18f012c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.294131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81df7b879e84eb289f352e9d18f012c'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.299761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1055/2131] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:23 2022] DELETE /identity/v3/users/f81df7b879e84eb289f352e9d18f012c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:23.304900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f54c68-90ae-4db1-9569-2ed816c73ff4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:23.305432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f54c68-90ae-4db1-9569-2ed816c73ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:23.305432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f54c68-90ae-4db1-9569-2ed816c73ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:23.325669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d4f54c68-90ae-4db1-9569-2ed816c73ff4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:23.326884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d4f54c68-90ae-4db1-9569-2ed816c73ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:23.384113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1077/2132] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:23.393653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:23.395110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:23.463806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7749-aca1-446c-a490-3ffb0b51ed5e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:23.467864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75421a70-c777-44bf-9241-2ac5ffe40515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:23.468455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75421a70-c777-44bf-9241-2ac5ffe40515 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:23.468768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75421a70-c777-44bf-9241-2ac5ffe40515 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:23.469045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75421a70-c777-44bf-9241-2ac5ffe40515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:23.479753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75421a70-c777-44bf-9241-2ac5ffe40515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:23.481368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75421a70-c777-44bf-9241-2ac5ffe40515 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:23.492170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1056/2133] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:01:23.760838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f54c68-90ae-4db1-9569-2ed816c73ff4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:23.762359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d4f54c68-90ae-4db1-9569-2ed816c73ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:23.776322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f54c68-90ae-4db1-9569-2ed816c73ff4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:23.781262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:23.782415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:23.782699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:23.782974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] PATH_INFO: `/v3/projects/758bc1ea92914ce08baa9f82fb7cbeb1` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:23.784532 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758bc1ea92914ce08baa9f82fb7cbeb1)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:23.786952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:23.830687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758bc1ea92914ce08baa9f82fb7cbeb1', 'request_id': 'req-f46bf10a-d6a7-485a-b233-5338ba0303a7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.837514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758bc1ea92914ce08baa9f82fb7cbeb1', 'request_id': 'req-f46bf10a-d6a7-485a-b233-5338ba0303a7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.843550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758bc1ea92914ce08baa9f82fb7cbeb1', 'request_id': 'req-f46bf10a-d6a7-485a-b233-5338ba0303a7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.854283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] The token cache is being invalidate because project 758bc1ea92914ce08baa9f82fb7cbeb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:23.854564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.855186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.856709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1078/2134] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:23 2022] DELETE /identity/v3/projects/758bc1ea92914ce08baa9f82fb7cbeb1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:23.860836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75421a70-c777-44bf-9241-2ac5ffe40515 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:23.870208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75421a70-c777-44bf-9241-2ac5ffe40515 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:23.926592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:23.927157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:23.927440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:23.927731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] PATH_INFO: `/v3/users/ac462da08f72487a94ac1746529c32b6` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:23.928917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac462da08f72487a94ac1746529c32b6)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:23.931022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:23.976841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac462da08f72487a94ac1746529c32b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.991156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac462da08f72487a94ac1746529c32b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.998791 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac462da08f72487a94ac1746529c32b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:23.999521 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac462da08f72487a94ac1746529c32b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.008720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9ef2d788-9b6c-428f-a11e-40bd8ca7ac55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac462da08f72487a94ac1746529c32b6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.015789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1057/2135] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:23 2022] DELETE /identity/v3/users/ac462da08f72487a94ac1746529c32b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:24.316898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:24.318550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:24.339217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bf10a-d6a7-485a-b233-5338ba0303a7 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:24.392526 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:24.393384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.393701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.393976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] PATH_INFO: `/v3/projects/fa1258b535554ef79ed825dba01a55d9` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.396239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1258b535554ef79ed825dba01a55d9)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:24.398203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:24.443066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1258b535554ef79ed825dba01a55d9', 'request_id': 'req-a14f8145-d364-4516-bb50-dc60c41b26f2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.449859 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1258b535554ef79ed825dba01a55d9', 'request_id': 'req-a14f8145-d364-4516-bb50-dc60c41b26f2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.455782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1258b535554ef79ed825dba01a55d9', 'request_id': 'req-a14f8145-d364-4516-bb50-dc60c41b26f2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.466302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] The token cache is being invalidate because project fa1258b535554ef79ed825dba01a55d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:24.466590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.467214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a14f8145-d364-4516-bb50-dc60c41b26f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.468741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1079/2136] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:24 2022] DELETE /identity/v3/projects/fa1258b535554ef79ed825dba01a55d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:24.473662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a898f-71e1-4fad-a517-f31b80ef628c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.474141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a898f-71e1-4fad-a517-f31b80ef628c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.474247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a898f-71e1-4fad-a517-f31b80ef628c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.493309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e17a898f-71e1-4fad-a517-f31b80ef628c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:24.494540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e17a898f-71e1-4fad-a517-f31b80ef628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:24.552314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1058/2137] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:24.561025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff949ec-d7ea-4cdf-a4d7-306e83a0a9e4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.561321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff949ec-d7ea-4cdf-a4d7-306e83a0a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.561644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff949ec-d7ea-4cdf-a4d7-306e83a0a9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.567988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a898f-71e1-4fad-a517-f31b80ef628c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:24.569383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e17a898f-71e1-4fad-a517-f31b80ef628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:24.581425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a898f-71e1-4fad-a517-f31b80ef628c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:24.587791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-fff949ec-d7ea-4cdf-a4d7-306e83a0a9e4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:24.588996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fff949ec-d7ea-4cdf-a4d7-306e83a0a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:24.591399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:24.592271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.592557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.592834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] PATH_INFO: `/v3/users/055b805a747746a19c57cd06c39396df` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.594184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055b805a747746a19c57cd06c39396df)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:24.596182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:24.597224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1080/2138] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:24.601403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff949ec-d7ea-4cdf-a4d7-306e83a0a9e4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:24.610281 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff949ec-d7ea-4cdf-a4d7-306e83a0a9e4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:24.615465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7429b2-a0c1-41b9-957c-4f0c37296581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:24.616115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7429b2-a0c1-41b9-957c-4f0c37296581 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.616400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7429b2-a0c1-41b9-957c-4f0c37296581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.616676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7429b2-a0c1-41b9-957c-4f0c37296581 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.617394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7429b2-a0c1-41b9-957c-4f0c37296581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:01:24.617742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7429b2-a0c1-41b9-957c-4f0c37296581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:24.619336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7429b2-a0c1-41b9-957c-4f0c37296581 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:24.631897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1081/2139] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:01:24.636023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7429b2-a0c1-41b9-957c-4f0c37296581 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:24.643083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055b805a747746a19c57cd06c39396df'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.645455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7429b2-a0c1-41b9-957c-4f0c37296581 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:24.650298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189008a-cfd0-4f19-9fd6-117c0db34c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:24.650925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189008a-cfd0-4f19-9fd6-117c0db34c69 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.651206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189008a-cfd0-4f19-9fd6-117c0db34c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.651503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189008a-cfd0-4f19-9fd6-117c0db34c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.652170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189008a-cfd0-4f19-9fd6-117c0db34c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:24.654083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189008a-cfd0-4f19-9fd6-117c0db34c69 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:24.655093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055b805a747746a19c57cd06c39396df'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.661661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055b805a747746a19c57cd06c39396df'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.662350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055b805a747746a19c57cd06c39396df'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.669953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-afbc63ef-8a4b-4a58-863f-71320a030ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055b805a747746a19c57cd06c39396df'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:24.676623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1059/2140] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:24 2022] DELETE /identity/v3/users/055b805a747746a19c57cd06c39396df => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:24.682070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1082/2141] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:01:24 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:01:24.682213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42104c-b891-48ff-81e5-53fd052df3d7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.682213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42104c-b891-48ff-81e5-53fd052df3d7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.682213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42104c-b891-48ff-81e5-53fd052df3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.683067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189008a-cfd0-4f19-9fd6-117c0db34c69 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:24.684672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b189008a-cfd0-4f19-9fd6-117c0db34c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:24.700528 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0a42104c-b891-48ff-81e5-53fd052df3d7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:24.701763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0a42104c-b891-48ff-81e5-53fd052df3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:24.748071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189008a-cfd0-4f19-9fd6-117c0db34c69 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:24.752813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4d371-1977-423e-89d1-09ab218694fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:24.753475 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4d371-1977-423e-89d1-09ab218694fe admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.757684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4d371-1977-423e-89d1-09ab218694fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.758000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4d371-1977-423e-89d1-09ab218694fe admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.758607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1060/2142] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:24.762324 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4d371-1977-423e-89d1-09ab218694fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:24.762324 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4d371-1977-423e-89d1-09ab218694fe admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:24.768968 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42104c-b891-48ff-81e5-53fd052df3d7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:24.770446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0a42104c-b891-48ff-81e5-53fd052df3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:24.784479 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1083/2143] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:01:24 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:01:24.788424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4d371-1977-423e-89d1-09ab218694fe admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:24.798050 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4d371-1977-423e-89d1-09ab218694fe admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:24.803369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61202df-79da-4e9c-a909-73aaced8fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:24.804007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61202df-79da-4e9c-a909-73aaced8fc89 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.804290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61202df-79da-4e9c-a909-73aaced8fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.804570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61202df-79da-4e9c-a909-73aaced8fc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.805280 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61202df-79da-4e9c-a909-73aaced8fc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:24.806915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61202df-79da-4e9c-a909-73aaced8fc89 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:24.817072 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1084/2144] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:01:24.821033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61202df-79da-4e9c-a909-73aaced8fc89 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:24.829782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42104c-b891-48ff-81e5-53fd052df3d7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:24.830242 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61202df-79da-4e9c-a909-73aaced8fc89 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:24.834013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c78ef4-e6a1-4ca8-bf7b-87ab3cbbc776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:24.834652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c78ef4-e6a1-4ca8-bf7b-87ab3cbbc776 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.834934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c78ef4-e6a1-4ca8-bf7b-87ab3cbbc776 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.835098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c3686-b156-44aa-aa05-3924e9875dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:24.835203 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c78ef4-e6a1-4ca8-bf7b-87ab3cbbc776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.835746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3686-b156-44aa-aa05-3924e9875dff admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.836033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3686-b156-44aa-aa05-3924e9875dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.836318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3686-b156-44aa-aa05-3924e9875dff admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.837023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c3686-b156-44aa-aa05-3924e9875dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:24.838632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c3686-b156-44aa-aa05-3924e9875dff admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:24.845340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c78ef4-e6a1-4ca8-bf7b-87ab3cbbc776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:24.846865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c78ef4-e6a1-4ca8-bf7b-87ab3cbbc776 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:24.850807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1085/2145] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:01:24.852990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c3686-b156-44aa-aa05-3924e9875dff admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:24.857819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1061/2146] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:01:24.862854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c3686-b156-44aa-aa05-3924e9875dff admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:24.868174 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731da842-924f-40c9-a2f6-4ca7efb6ccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:24.869045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731da842-924f-40c9-a2f6-4ca7efb6ccea admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.869324 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731da842-924f-40c9-a2f6-4ca7efb6ccea admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.869669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731da842-924f-40c9-a2f6-4ca7efb6ccea admin admin] PATH_INFO: `/v3/projects/f9e8bd7b2ec648bd80660891768859cb/users/2e945c31874b476c93ea11fc00e7a6c5/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.884539 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731da842-924f-40c9-a2f6-4ca7efb6ccea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e8bd7b2ec648bd80660891768859cb, user_id=2e945c31874b476c93ea11fc00e7a6c5, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:24.887226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731da842-924f-40c9-a2f6-4ca7efb6ccea admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:24.901120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1086/2147] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:24 2022] PUT /identity/v3/projects/f9e8bd7b2ec648bd80660891768859cb/users/2e945c31874b476c93ea11fc00e7a6c5/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:01:24.912113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6188478-1143-4298-bc6e-2ba820a3f9aa None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:24.912406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6188478-1143-4298-bc6e-2ba820a3f9aa None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:24.912683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6188478-1143-4298-bc6e-2ba820a3f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:24.941143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f6188478-1143-4298-bc6e-2ba820a3f9aa None None] MFA Rules not processed for user `2e945c31874b476c93ea11fc00e7a6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:24.942985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f6188478-1143-4298-bc6e-2ba820a3f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:25.010783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1062/2148] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:25.015190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731da842-924f-40c9-a2f6-4ca7efb6ccea admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:25.087698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731da842-924f-40c9-a2f6-4ca7efb6ccea admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:25.098733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cd968-ee1a-43dc-9785-a67f31eeddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:25.099492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cd968-ee1a-43dc-9785-a67f31eeddc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:25.099787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cd968-ee1a-43dc-9785-a67f31eeddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:25.100643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cd968-ee1a-43dc-9785-a67f31eeddc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:25.103109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cd968-ee1a-43dc-9785-a67f31eeddc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:25.110114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cd968-ee1a-43dc-9785-a67f31eeddc0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:25.141576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6188478-1143-4298-bc6e-2ba820a3f9aa None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:25.143100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f6188478-1143-4298-bc6e-2ba820a3f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:25.165718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1087/2149] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:01:25 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:25.166637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cd968-ee1a-43dc-9785-a67f31eeddc0 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:25.171860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6188478-1143-4298-bc6e-2ba820a3f9aa None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:25.246702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:25.247951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:25.248334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:25.248709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] PATH_INFO: `/v3/projects/97dda6e8bb014ca09e89d1f29ea6079d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:25.250141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97dda6e8bb014ca09e89d1f29ea6079d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:25.252216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:25.255977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cd968-ee1a-43dc-9785-a67f31eeddc0 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:25.263288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df3c41-37b3-42bf-bb85-d7ce95795e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:25.263972 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df3c41-37b3-42bf-bb85-d7ce95795e28 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:25.264390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df3c41-37b3-42bf-bb85-d7ce95795e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:25.264616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df3c41-37b3-42bf-bb85-d7ce95795e28 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:25.265315 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df3c41-37b3-42bf-bb85-d7ce95795e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:25.268243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df3c41-37b3-42bf-bb85-d7ce95795e28 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:25.307439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1088/2150] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:01:25 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:25.308316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df3c41-37b3-42bf-bb85-d7ce95795e28 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:25.323197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df3c41-37b3-42bf-bb85-d7ce95795e28 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:25.331404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97dda6e8bb014ca09e89d1f29ea6079d', 'request_id': 'req-d404148b-7416-4dd0-9ce3-3a5aaf29292a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:25.347798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97dda6e8bb014ca09e89d1f29ea6079d', 'request_id': 'req-d404148b-7416-4dd0-9ce3-3a5aaf29292a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:25.356077 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97dda6e8bb014ca09e89d1f29ea6079d', 'request_id': 'req-d404148b-7416-4dd0-9ce3-3a5aaf29292a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:25.400752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ccd5e-297b-485c-8125-60676ea10b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:25.401455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ccd5e-297b-485c-8125-60676ea10b0b admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:25.401766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ccd5e-297b-485c-8125-60676ea10b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:25.402040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ccd5e-297b-485c-8125-60676ea10b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:25.402763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ccd5e-297b-485c-8125-60676ea10b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:25.404410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ccd5e-297b-485c-8125-60676ea10b0b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:25.410935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] The token cache is being invalidate because project 97dda6e8bb014ca09e89d1f29ea6079d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:25.411232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:25.411986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:25.413739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1063/2151] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:25 2022] DELETE /identity/v3/projects/97dda6e8bb014ca09e89d1f29ea6079d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:01:25.416239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1089/2152] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:01:25.430646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:25.454483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:25.543870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404148b-7416-4dd0-9ce3-3a5aaf29292a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:25.549483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c4b43-bd46-44c9-97de-1e3dac35a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:25.550221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c4b43-bd46-44c9-97de-1e3dac35a20e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:25.550503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c4b43-bd46-44c9-97de-1e3dac35a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:25.551517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c4b43-bd46-44c9-97de-1e3dac35a20e admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:25.552278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c4b43-bd46-44c9-97de-1e3dac35a20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:25.553970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c4b43-bd46-44c9-97de-1e3dac35a20e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:25.570340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1064/2153] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:25.571072 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ccd5e-297b-485c-8125-60676ea10b0b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:25.662595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ccd5e-297b-485c-8125-60676ea10b0b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:25.671980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27373fa-be04-42d1-9240-3ba96d847494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:25.672860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27373fa-be04-42d1-9240-3ba96d847494 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:25.673143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27373fa-be04-42d1-9240-3ba96d847494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:25.673411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27373fa-be04-42d1-9240-3ba96d847494 admin admin] PATH_INFO: `/v3/projects/621c05b7987a469ca6e42cfe6a485d23/users/8a0d1f4d519f4e2abea73ace203d486f/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:25.688796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27373fa-be04-42d1-9240-3ba96d847494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621c05b7987a469ca6e42cfe6a485d23, user_id=8a0d1f4d519f4e2abea73ace203d486f, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:25.692448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27373fa-be04-42d1-9240-3ba96d847494 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:25.705996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1090/2154] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:25 2022] PUT /identity/v3/projects/621c05b7987a469ca6e42cfe6a485d23/users/8a0d1f4d519f4e2abea73ace203d486f/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:25.716582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d0e5-f4d9-459a-8183-cf22488e94f1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:25.716867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d0e5-f4d9-459a-8183-cf22488e94f1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:25.717150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d0e5-f4d9-459a-8183-cf22488e94f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:25.744379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6a05d0e5-f4d9-459a-8183-cf22488e94f1 None None] MFA Rules not processed for user `8a0d1f4d519f4e2abea73ace203d486f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:25.745608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6a05d0e5-f4d9-459a-8183-cf22488e94f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:25.807276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1065/2155] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:25.811883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27373fa-be04-42d1-9240-3ba96d847494 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:25.871797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27373fa-be04-42d1-9240-3ba96d847494 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:25.876217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb36887-5c3b-45cf-9a60-138c995078c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:25.876858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb36887-5c3b-45cf-9a60-138c995078c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:25.877134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb36887-5c3b-45cf-9a60-138c995078c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:25.877405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb36887-5c3b-45cf-9a60-138c995078c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:25.878122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb36887-5c3b-45cf-9a60-138c995078c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:25.880564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb36887-5c3b-45cf-9a60-138c995078c9 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:25.904403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1091/2156] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:01:25 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:01:25.908498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d0e5-f4d9-459a-8183-cf22488e94f1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:25.919246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d0e5-f4d9-459a-8183-cf22488e94f1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:25.973541 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d3de3-32ab-4751-aeb6-74139cb60227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:25.974220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d3de3-32ab-4751-aeb6-74139cb60227 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:25.974502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d3de3-32ab-4751-aeb6-74139cb60227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:25.974775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d3de3-32ab-4751-aeb6-74139cb60227 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:25.975469 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d3de3-32ab-4751-aeb6-74139cb60227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:25.977372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d3de3-32ab-4751-aeb6-74139cb60227 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:25.996501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1066/2157] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:01:25 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:26.000543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb36887-5c3b-45cf-9a60-138c995078c9 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:26.011205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb36887-5c3b-45cf-9a60-138c995078c9 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:26.015783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81e8f1-a8af-418d-b06b-950add1c12d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:26.016439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81e8f1-a8af-418d-b06b-950add1c12d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:26.016721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81e8f1-a8af-418d-b06b-950add1c12d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:26.016992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81e8f1-a8af-418d-b06b-950add1c12d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:26.017747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81e8f1-a8af-418d-b06b-950add1c12d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:26.019393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81e8f1-a8af-418d-b06b-950add1c12d7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:26.029624 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1092/2158] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:26.033579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d3de3-32ab-4751-aeb6-74139cb60227 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:26.043693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d3de3-32ab-4751-aeb6-74139cb60227 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:26.048290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923f71-8359-4ade-9fd6-a8ed18432652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:26.049151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923f71-8359-4ade-9fd6-a8ed18432652 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:26.049432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923f71-8359-4ade-9fd6-a8ed18432652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:26.049738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923f71-8359-4ade-9fd6-a8ed18432652 admin admin] PATH_INFO: `/v3/projects/e5b2a709f8d440a88c06463ad7b33d8e/users/b415b9e658504dd38797b72fe834de3b/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:26.064444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc923f71-8359-4ade-9fd6-a8ed18432652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b2a709f8d440a88c06463ad7b33d8e, user_id=b415b9e658504dd38797b72fe834de3b, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:26.067777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc923f71-8359-4ade-9fd6-a8ed18432652 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:26.079883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1067/2159] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:26 2022] PUT /identity/v3/projects/e5b2a709f8d440a88c06463ad7b33d8e/users/b415b9e658504dd38797b72fe834de3b/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:26.083758 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81e8f1-a8af-418d-b06b-950add1c12d7 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:26.094149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81e8f1-a8af-418d-b06b-950add1c12d7 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:26.150261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18888509-d1d4-4c45-b5a2-215a9960a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:26.150916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18888509-d1d4-4c45-b5a2-215a9960a9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:26.151194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18888509-d1d4-4c45-b5a2-215a9960a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:26.151467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18888509-d1d4-4c45-b5a2-215a9960a9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:26.152180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18888509-d1d4-4c45-b5a2-215a9960a9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:26.153798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18888509-d1d4-4c45-b5a2-215a9960a9e7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:26.163110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1093/2160] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:26.167562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923f71-8359-4ade-9fd6-a8ed18432652 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:26.178330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923f71-8359-4ade-9fd6-a8ed18432652 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:26.182923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07d7c-8e42-4f9d-8552-94b1e79bbbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:26.183793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07d7c-8e42-4f9d-8552-94b1e79bbbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:26.184076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07d7c-8e42-4f9d-8552-94b1e79bbbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:26.184351 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07d7c-8e42-4f9d-8552-94b1e79bbbb6 admin admin] PATH_INFO: `/v3/projects/e5b2a709f8d440a88c06463ad7b33d8e/users/b415b9e658504dd38797b72fe834de3b/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:26.186411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07d7c-8e42-4f9d-8552-94b1e79bbbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b2a709f8d440a88c06463ad7b33d8e, user_id=b415b9e658504dd38797b72fe834de3b, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:26.189084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07d7c-8e42-4f9d-8552-94b1e79bbbb6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:26.200192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1068/2161] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:26 2022] PUT /identity/v3/projects/e5b2a709f8d440a88c06463ad7b33d8e/users/b415b9e658504dd38797b72fe834de3b/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:01:26.211726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa6a24-49e4-4eef-bd20-ff91c125acff None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:26.212017 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa6a24-49e4-4eef-bd20-ff91c125acff None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:26.212293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa6a24-49e4-4eef-bd20-ff91c125acff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:26.237596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-a7aa6a24-49e4-4eef-bd20-ff91c125acff None None] MFA Rules not processed for user `b415b9e658504dd38797b72fe834de3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:26.239327 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a7aa6a24-49e4-4eef-bd20-ff91c125acff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:26.303110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1094/2162] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:26.314044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07d7c-8e42-4f9d-8552-94b1e79bbbb6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:26.315719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-70b07d7c-8e42-4f9d-8552-94b1e79bbbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:26.389516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07d7c-8e42-4f9d-8552-94b1e79bbbb6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:26.393267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066eafe-b155-4d77-8cd9-0972af23f0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:26.393941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066eafe-b155-4d77-8cd9-0972af23f0ac service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:26.394232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066eafe-b155-4d77-8cd9-0972af23f0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:26.394507 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066eafe-b155-4d77-8cd9-0972af23f0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:26.403378 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066eafe-b155-4d77-8cd9-0972af23f0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:26.404806 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066eafe-b155-4d77-8cd9-0972af23f0ac service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:26.414748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1069/2163] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:01:26.455509 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa6a24-49e4-4eef-bd20-ff91c125acff None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:26.456961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a7aa6a24-49e4-4eef-bd20-ff91c125acff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:26.468620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa6a24-49e4-4eef-bd20-ff91c125acff None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:26.472988 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cdf32-81d3-4dea-a548-16f90d23c4ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:26.473724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cdf32-81d3-4dea-a548-16f90d23c4ee service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:26.474089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cdf32-81d3-4dea-a548-16f90d23c4ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:26.474347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cdf32-81d3-4dea-a548-16f90d23c4ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:26.476102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ac9cdf32-81d3-4dea-a548-16f90d23c4ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:26.539640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cdf32-81d3-4dea-a548-16f90d23c4ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:26.541092 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cdf32-81d3-4dea-a548-16f90d23c4ee service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:26.553407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1095/2164] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:01:29.103593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2b37-4c5e-491f-8ed4-ca337b88efdb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:29.103593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2b37-4c5e-491f-8ed4-ca337b88efdb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:29.103593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2b37-4c5e-491f-8ed4-ca337b88efdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:29.121265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-50cc2b37-4c5e-491f-8ed4-ca337b88efdb None None] MFA Rules not processed for user `e1ebd0110fff4620b11e881c90470cda`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:29.125415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-50cc2b37-4c5e-491f-8ed4-ca337b88efdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:29.181642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1070/2165] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:29.463586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cdf32-81d3-4dea-a548-16f90d23c4ee service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:29.535117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cdf32-81d3-4dea-a548-16f90d23c4ee service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:29.541254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:29.542187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:29.542465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:29.542735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] PATH_INFO: `/v3/users/2e945c31874b476c93ea11fc00e7a6c5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:29.543921 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e945c31874b476c93ea11fc00e7a6c5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:29.545860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:29.593395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e945c31874b476c93ea11fc00e7a6c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:29.594135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e945c31874b476c93ea11fc00e7a6c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:29.606799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e945c31874b476c93ea11fc00e7a6c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:29.607472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e945c31874b476c93ea11fc00e7a6c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:29.616444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e945c31874b476c93ea11fc00e7a6c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:29.628667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1096/2166] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:29 2022] DELETE /identity/v3/users/2e945c31874b476c93ea11fc00e7a6c5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:29.632849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5a37-41f7-43f7-b4a6-0ebffa06c5a4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:29.633140 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5a37-41f7-43f7-b4a6-0ebffa06c5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:29.633415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5a37-41f7-43f7-b4a6-0ebffa06c5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:29.659382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-eece5a37-41f7-43f7-b4a6-0ebffa06c5a4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:29.661160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-eece5a37-41f7-43f7-b4a6-0ebffa06c5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:29.721101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1071/2167] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:29.731375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:29.733005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:29.828980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed519a-a965-4af7-8039-6176614b86b1 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:29.833695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52a42f-e3c9-4cea-8a28-e7d3d5164f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:29.834345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52a42f-e3c9-4cea-8a28-e7d3d5164f49 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:29.834626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52a42f-e3c9-4cea-8a28-e7d3d5164f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:29.834897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52a42f-e3c9-4cea-8a28-e7d3d5164f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:29.846956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52a42f-e3c9-4cea-8a28-e7d3d5164f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:29.849113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52a42f-e3c9-4cea-8a28-e7d3d5164f49 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:29.867876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1097/2168] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:01:30.182220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5a37-41f7-43f7-b4a6-0ebffa06c5a4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:30.184020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-eece5a37-41f7-43f7-b4a6-0ebffa06c5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:30.201128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5a37-41f7-43f7-b4a6-0ebffa06c5a4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:30.225622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:30.226674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:30.227127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:30.227543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] PATH_INFO: `/v3/projects/f9e8bd7b2ec648bd80660891768859cb` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:30.228905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e8bd7b2ec648bd80660891768859cb)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:30.231169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:30.235676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52a42f-e3c9-4cea-8a28-e7d3d5164f49 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:30.237180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5a52a42f-e3c9-4cea-8a28-e7d3d5164f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:30.264128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52a42f-e3c9-4cea-8a28-e7d3d5164f49 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:30.271745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:30.272640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:30.272922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:30.273196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] PATH_INFO: `/v3/users/e4da98d45e3d4d7ca673225a9806a3bc` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:30.274442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4da98d45e3d4d7ca673225a9806a3bc)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:30.276388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:30.286058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e8bd7b2ec648bd80660891768859cb', 'request_id': 'req-5821612f-0377-43bb-875a-2944594668fa'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.294996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e8bd7b2ec648bd80660891768859cb', 'request_id': 'req-5821612f-0377-43bb-875a-2944594668fa'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.301253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e8bd7b2ec648bd80660891768859cb', 'request_id': 'req-5821612f-0377-43bb-875a-2944594668fa'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.313236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] The token cache is being invalidate because project f9e8bd7b2ec648bd80660891768859cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:30.313775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.314581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.316289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1072/2169] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:30 2022] DELETE /identity/v3/projects/f9e8bd7b2ec648bd80660891768859cb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:30.320850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:30.322476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:30.328214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4da98d45e3d4d7ca673225a9806a3bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.329015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4da98d45e3d4d7ca673225a9806a3bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.342652 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4da98d45e3d4d7ca673225a9806a3bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.343514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4da98d45e3d4d7ca673225a9806a3bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.351269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1db22b88-d85e-4928-a62a-af82893d4a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4da98d45e3d4d7ca673225a9806a3bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.365118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1098/2170] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:30 2022] DELETE /identity/v3/users/e4da98d45e3d4d7ca673225a9806a3bc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:30.369307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba9f2-64a3-40f9-ac25-a5429d6d0bc7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:30.369626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba9f2-64a3-40f9-ac25-a5429d6d0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:30.369967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba9f2-64a3-40f9-ac25-a5429d6d0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:30.386899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b66ba9f2-64a3-40f9-ac25-a5429d6d0bc7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:30.388102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b66ba9f2-64a3-40f9-ac25-a5429d6d0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:30.392474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821612f-0377-43bb-875a-2944594668fa admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:30.449382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1099/2171] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:01:30.451771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:30.452648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:30.452934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:30.453305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] PATH_INFO: `/v3/users/8a0d1f4d519f4e2abea73ace203d486f` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:30.454599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0d1f4d519f4e2abea73ace203d486f)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:30.456537 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:30.460582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba9f2-64a3-40f9-ac25-a5429d6d0bc7 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:30.462118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b66ba9f2-64a3-40f9-ac25-a5429d6d0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:30.508967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0d1f4d519f4e2abea73ace203d486f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.522095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0d1f4d519f4e2abea73ace203d486f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.524834 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba9f2-64a3-40f9-ac25-a5429d6d0bc7 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:30.528570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a52d01-8975-45b1-8e68-eb15e1ec83e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:30.529216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a52d01-8975-45b1-8e68-eb15e1ec83e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:30.529499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a52d01-8975-45b1-8e68-eb15e1ec83e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:30.529809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a52d01-8975-45b1-8e68-eb15e1ec83e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:30.530484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0d1f4d519f4e2abea73ace203d486f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.531192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0d1f4d519f4e2abea73ace203d486f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.539393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0d1f4d519f4e2abea73ace203d486f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.541203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a52d01-8975-45b1-8e68-eb15e1ec83e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:30.542765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a52d01-8975-45b1-8e68-eb15e1ec83e3 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:30.545744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1073/2172] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:30 2022] DELETE /identity/v3/users/8a0d1f4d519f4e2abea73ace203d486f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:01:30.553259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1100/2173] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:01:30.821329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:30.823108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:30.838444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a52d01-8975-45b1-8e68-eb15e1ec83e3 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:30.840025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f9a52d01-8975-45b1-8e68-eb15e1ec83e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:30.855000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a52d01-8975-45b1-8e68-eb15e1ec83e3 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:30.902036 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47893f6-d639-461b-b0e3-267974d0ddae admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:30.907555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:30.909200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:30.909642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:30.910599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] PATH_INFO: `/v3/projects/621c05b7987a469ca6e42cfe6a485d23` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:30.912023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621c05b7987a469ca6e42cfe6a485d23)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:30.914316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:30.915865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:30.916703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:30.916990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:30.917264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] PATH_INFO: `/v3/projects/86e71bd9c8474ff39d5317b0b3c14a7f` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:30.918493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e71bd9c8474ff39d5317b0b3c14a7f)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:30.920516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:30.971418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621c05b7987a469ca6e42cfe6a485d23', 'request_id': 'req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.977132 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e71bd9c8474ff39d5317b0b3c14a7f', 'request_id': 'req-0c5a1b4e-af30-47d0-aab4-c67523612cfb'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.979196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621c05b7987a469ca6e42cfe6a485d23', 'request_id': 'req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.984285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e71bd9c8474ff39d5317b0b3c14a7f', 'request_id': 'req-0c5a1b4e-af30-47d0-aab4-c67523612cfb'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.987377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621c05b7987a469ca6e42cfe6a485d23', 'request_id': 'req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.991364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e71bd9c8474ff39d5317b0b3c14a7f', 'request_id': 'req-0c5a1b4e-af30-47d0-aab4-c67523612cfb'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:30.999404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] The token cache is being invalidate because project 621c05b7987a469ca6e42cfe6a485d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:30.999693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.000344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.001928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1074/2174] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:30 2022] DELETE /identity/v3/projects/621c05b7987a469ca6e42cfe6a485d23 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:31.004385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] The token cache is being invalidate because project 86e71bd9c8474ff39d5317b0b3c14a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:31.004689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.005456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0c5a1b4e-af30-47d0-aab4-c67523612cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.007430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:31.008774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:31.011098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1101/2175] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:30 2022] DELETE /identity/v3/projects/86e71bd9c8474ff39d5317b0b3c14a7f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:31.012631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b661-df79-4c6f-8494-17694da15fdb None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.012942 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b661-df79-4c6f-8494-17694da15fdb None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.013202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b661-df79-4c6f-8494-17694da15fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.053159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6de8b661-df79-4c6f-8494-17694da15fdb None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:31.054407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6de8b661-df79-4c6f-8494-17694da15fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:31.075453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751ad17-c07b-4cbf-a5db-dd9a695b19c6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:31.111285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1102/2176] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:01:31.119803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337c22d-f33c-4937-a967-4149caf07c22 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.120096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337c22d-f33c-4937-a967-4149caf07c22 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.120375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337c22d-f33c-4937-a967-4149caf07c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.130061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:31.130944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.131223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.131494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] PATH_INFO: `/v3/users/b415b9e658504dd38797b72fe834de3b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.132722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b415b9e658504dd38797b72fe834de3b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:31.134792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:31.146216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2337c22d-f33c-4937-a967-4149caf07c22 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:31.147695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2337c22d-f33c-4937-a967-4149caf07c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:31.156628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1103/2177] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:31.160966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337c22d-f33c-4937-a967-4149caf07c22 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:31.170702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337c22d-f33c-4937-a967-4149caf07c22 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:31.176113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a14e5e-692f-49c0-957a-665cd778d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:31.176714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a14e5e-692f-49c0-957a-665cd778d5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.176998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a14e5e-692f-49c0-957a-665cd778d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.177453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a14e5e-692f-49c0-957a-665cd778d5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.178221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a14e5e-692f-49c0-957a-665cd778d5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:01:31.178532 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a14e5e-692f-49c0-957a-665cd778d5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:31.180341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a14e5e-692f-49c0-957a-665cd778d5f0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:31.191894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b415b9e658504dd38797b72fe834de3b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.193631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1104/2178] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:01:31.197929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a14e5e-692f-49c0-957a-665cd778d5f0 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:31.206710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b415b9e658504dd38797b72fe834de3b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.209183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a14e5e-692f-49c0-957a-665cd778d5f0 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:31.214313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fa1a5-f08c-4fe4-bcf2-af32d52cd704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:31.215214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fa1a5-f08c-4fe4-bcf2-af32d52cd704 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.215403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fa1a5-f08c-4fe4-bcf2-af32d52cd704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.215689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fa1a5-f08c-4fe4-bcf2-af32d52cd704 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.216389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fa1a5-f08c-4fe4-bcf2-af32d52cd704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:31.216968 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b415b9e658504dd38797b72fe834de3b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.217746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b415b9e658504dd38797b72fe834de3b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.218728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fa1a5-f08c-4fe4-bcf2-af32d52cd704 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:31.227759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b415b9e658504dd38797b72fe834de3b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.241176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1075/2179] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:31 2022] DELETE /identity/v3/users/b415b9e658504dd38797b72fe834de3b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:01:31.254932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1105/2180] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:01:31 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:31.259001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:31.260550 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:31.334522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ea1af-f7d3-4951-a31b-1e565041f68a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:31.399583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd040d3-c3a0-4b17-af1b-a2b497d30808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:31.400262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd040d3-c3a0-4b17-af1b-a2b497d30808 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.400549 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd040d3-c3a0-4b17-af1b-a2b497d30808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.400825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd040d3-c3a0-4b17-af1b-a2b497d30808 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.401576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd040d3-c3a0-4b17-af1b-a2b497d30808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:31.403648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd040d3-c3a0-4b17-af1b-a2b497d30808 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:31.434742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1076/2181] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:01:31 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:31.435884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fa1a5-f08c-4fe4-bcf2-af32d52cd704 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:31.447754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fa1a5-f08c-4fe4-bcf2-af32d52cd704 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:31.452700 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46d2fa-64d1-41dd-b9d1-3ee1ab3f5324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:31.453722 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46d2fa-64d1-41dd-b9d1-3ee1ab3f5324 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.454167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46d2fa-64d1-41dd-b9d1-3ee1ab3f5324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.454496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46d2fa-64d1-41dd-b9d1-3ee1ab3f5324 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.455169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46d2fa-64d1-41dd-b9d1-3ee1ab3f5324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:31.456737 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46d2fa-64d1-41dd-b9d1-3ee1ab3f5324 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:31.467142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1106/2182] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:31.471551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd040d3-c3a0-4b17-af1b-a2b497d30808 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:31.481727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd040d3-c3a0-4b17-af1b-a2b497d30808 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:31.486743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92d9fd-5cd1-4e17-9296-441a645d4aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:31.487536 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d9fd-5cd1-4e17-9296-441a645d4aff admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.487918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d9fd-5cd1-4e17-9296-441a645d4aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.489207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d9fd-5cd1-4e17-9296-441a645d4aff admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.489782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92d9fd-5cd1-4e17-9296-441a645d4aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:31.491485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92d9fd-5cd1-4e17-9296-441a645d4aff admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:31.505602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1077/2183] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:01:31.506932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46d2fa-64d1-41dd-b9d1-3ee1ab3f5324 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:31.517180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46d2fa-64d1-41dd-b9d1-3ee1ab3f5324 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:31.521479 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa3a47-654f-4bd8-a7b1-e88196b02f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:31.522375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa3a47-654f-4bd8-a7b1-e88196b02f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.522654 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa3a47-654f-4bd8-a7b1-e88196b02f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.522925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa3a47-654f-4bd8-a7b1-e88196b02f75 admin admin] PATH_INFO: `/v3/projects/b1e982ed51d9445b8f05cb7ddee40660/users/e32c7724a2f74e0fa25b0f596be7c81b/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.538530 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa3a47-654f-4bd8-a7b1-e88196b02f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e982ed51d9445b8f05cb7ddee40660, user_id=e32c7724a2f74e0fa25b0f596be7c81b, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:31.543371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa3a47-654f-4bd8-a7b1-e88196b02f75 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:31.573889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1107/2184] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:31 2022] PUT /identity/v3/projects/b1e982ed51d9445b8f05cb7ddee40660/users/e32c7724a2f74e0fa25b0f596be7c81b/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:31.584152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d38fa8-2c31-4d74-aa37-a8d8259beaec None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.584452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d38fa8-2c31-4d74-aa37-a8d8259beaec None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.585070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d38fa8-2c31-4d74-aa37-a8d8259beaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.610515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c4d38fa8-2c31-4d74-aa37-a8d8259beaec None None] MFA Rules not processed for user `e32c7724a2f74e0fa25b0f596be7c81b`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:31.611719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c4d38fa8-2c31-4d74-aa37-a8d8259beaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:31.688266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1078/2185] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:31.700340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa3a47-654f-4bd8-a7b1-e88196b02f75 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:31.702069 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d3fa3a47-654f-4bd8-a7b1-e88196b02f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:31.757933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa3a47-654f-4bd8-a7b1-e88196b02f75 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:31.762131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e790e1-ea09-4bbe-b195-6b8b99ca450e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:31.762827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e790e1-ea09-4bbe-b195-6b8b99ca450e service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.763060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e790e1-ea09-4bbe-b195-6b8b99ca450e service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.763332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e790e1-ea09-4bbe-b195-6b8b99ca450e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.768816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d38fa8-2c31-4d74-aa37-a8d8259beaec None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:31.774342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e790e1-ea09-4bbe-b195-6b8b99ca450e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:31.775825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e790e1-ea09-4bbe-b195-6b8b99ca450e service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:31.778607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c4d38fa8-2c31-4d74-aa37-a8d8259beaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:31.788222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1108/2186] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:01:31.864031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d38fa8-2c31-4d74-aa37-a8d8259beaec None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:31.869496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:31.870091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.870375 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.870673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] PATH_INFO: `/v3/projects/e5b2a709f8d440a88c06463ad7b33d8e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.872095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b2a709f8d440a88c06463ad7b33d8e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:31.874259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:31.925310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b2a709f8d440a88c06463ad7b33d8e', 'request_id': 'req-ab0e389d-7cff-4485-8c29-b6e6ceba300d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.934579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b2a709f8d440a88c06463ad7b33d8e', 'request_id': 'req-ab0e389d-7cff-4485-8c29-b6e6ceba300d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.941088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b2a709f8d440a88c06463ad7b33d8e', 'request_id': 'req-ab0e389d-7cff-4485-8c29-b6e6ceba300d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.952423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] The token cache is being invalidate because project e5b2a709f8d440a88c06463ad7b33d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:31.952730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.953369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ab0e389d-7cff-4485-8c29-b6e6ceba300d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:31.955178 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1079/2187] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:31 2022] DELETE /identity/v3/projects/e5b2a709f8d440a88c06463ad7b33d8e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:31.961289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366430d4-1d34-46de-9766-193315d454b0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:31.961609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366430d4-1d34-46de-9766-193315d454b0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:31.961894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366430d4-1d34-46de-9766-193315d454b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:31.984731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-366430d4-1d34-46de-9766-193315d454b0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:31.986206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-366430d4-1d34-46de-9766-193315d454b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:32.066769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31721-e005-40c6-b109-3c8ef899f30f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.067062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31721-e005-40c6-b109-3c8ef899f30f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.067432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31721-e005-40c6-b109-3c8ef899f30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.076628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1109/2188] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:32.089118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d9e31721-e005-40c6-b109-3c8ef899f30f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:32.090620 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d9e31721-e005-40c6-b109-3c8ef899f30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:32.114480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1080/2189] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:01:32.115153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366430d4-1d34-46de-9766-193315d454b0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:32.133070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366430d4-1d34-46de-9766-193315d454b0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:32.140268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983c448-ad4d-4470-b482-015d9ef85b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:32.140934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c448-ad4d-4470-b482-015d9ef85b06 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.141217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c448-ad4d-4470-b482-015d9ef85b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.141493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c448-ad4d-4470-b482-015d9ef85b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.142263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983c448-ad4d-4470-b482-015d9ef85b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:01:32.142574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983c448-ad4d-4470-b482-015d9ef85b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:32.144179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983c448-ad4d-4470-b482-015d9ef85b06 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:32.164126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1110/2190] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:01:32.168661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31721-e005-40c6-b109-3c8ef899f30f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:32.180316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31721-e005-40c6-b109-3c8ef899f30f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:32.186848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a6f0d-7614-41ab-b57f-2bb64d81b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:32.187580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a6f0d-7614-41ab-b57f-2bb64d81b9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.187936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a6f0d-7614-41ab-b57f-2bb64d81b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.188216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a6f0d-7614-41ab-b57f-2bb64d81b9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.188914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a6f0d-7614-41ab-b57f-2bb64d81b9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:32.191094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a6f0d-7614-41ab-b57f-2bb64d81b9b4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:32.224297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1081/2191] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:01:32 2022] POST /identity/v3/projects => generated 359 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:32.228555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983c448-ad4d-4470-b482-015d9ef85b06 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:32.239504 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983c448-ad4d-4470-b482-015d9ef85b06 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:32.304666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca5a6-a46b-4296-b1a3-ba3a97417fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:32.305483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca5a6-a46b-4296-b1a3-ba3a97417fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.305887 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca5a6-a46b-4296-b1a3-ba3a97417fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.306269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca5a6-a46b-4296-b1a3-ba3a97417fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.307088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ca5a6-a46b-4296-b1a3-ba3a97417fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:32.309139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ca5a6-a46b-4296-b1a3-ba3a97417fe5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:32.333583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1111/2192] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:01:32 2022] POST /identity/v3/users => generated 280 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:01:32.337639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a6f0d-7614-41ab-b57f-2bb64d81b9b4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:32.349756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a6f0d-7614-41ab-b57f-2bb64d81b9b4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:32.355084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdda68-35c6-4c95-9453-e8e93413310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:32.355768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdda68-35c6-4c95-9453-e8e93413310c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.356067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdda68-35c6-4c95-9453-e8e93413310c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.356305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdda68-35c6-4c95-9453-e8e93413310c admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.357056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdda68-35c6-4c95-9453-e8e93413310c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:32.362232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdda68-35c6-4c95-9453-e8e93413310c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:32.382691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1082/2193] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:32.386398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca5a6-a46b-4296-b1a3-ba3a97417fe5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:32.398270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca5a6-a46b-4296-b1a3-ba3a97417fe5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:32.404658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca34ec8-3984-4a98-9a77-734af70faabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:32.405408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca34ec8-3984-4a98-9a77-734af70faabb admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.405786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca34ec8-3984-4a98-9a77-734af70faabb admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.406168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca34ec8-3984-4a98-9a77-734af70faabb admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.407110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca34ec8-3984-4a98-9a77-734af70faabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:32.408948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca34ec8-3984-4a98-9a77-734af70faabb admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:32.424837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1112/2194] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:01:32.428415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdda68-35c6-4c95-9453-e8e93413310c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:32.438508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdda68-35c6-4c95-9453-e8e93413310c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:32.444469 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50b4a4-6f5f-4e57-94a2-8f07765bf71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:32.445355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50b4a4-6f5f-4e57-94a2-8f07765bf71e admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.445672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50b4a4-6f5f-4e57-94a2-8f07765bf71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.445945 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50b4a4-6f5f-4e57-94a2-8f07765bf71e admin admin] PATH_INFO: `/v3/projects/4fa932d156354a5b94ce28dfa22af61c/users/7c5ae8218f3241cf9598984043a38058/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.462364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50b4a4-6f5f-4e57-94a2-8f07765bf71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa932d156354a5b94ce28dfa22af61c, user_id=7c5ae8218f3241cf9598984043a38058, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:32.465053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50b4a4-6f5f-4e57-94a2-8f07765bf71e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:32.483410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1083/2195] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:01:32 2022] PUT /identity/v3/projects/4fa932d156354a5b94ce28dfa22af61c/users/7c5ae8218f3241cf9598984043a38058/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:32.496006 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50fc70-451a-41d9-84e9-4f278f48cfa6 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.496274 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50fc70-451a-41d9-84e9-4f278f48cfa6 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.496557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50fc70-451a-41d9-84e9-4f278f48cfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.524191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-ac50fc70-451a-41d9-84e9-4f278f48cfa6 None None] MFA Rules not processed for user `7c5ae8218f3241cf9598984043a38058`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:32.525415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ac50fc70-451a-41d9-84e9-4f278f48cfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:32.595223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1113/2196] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:32 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:32.628471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50b4a4-6f5f-4e57-94a2-8f07765bf71e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:32.631442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ce50b4a4-6f5f-4e57-94a2-8f07765bf71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:32.714950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50b4a4-6f5f-4e57-94a2-8f07765bf71e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:32.720965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a22a-c8ee-460f-906e-40933665c5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:32.721674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a22a-c8ee-460f-906e-40933665c5ad service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.721961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a22a-c8ee-460f-906e-40933665c5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.722237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a22a-c8ee-460f-906e-40933665c5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.731446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0a22a-c8ee-460f-906e-40933665c5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:32.733159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0a22a-c8ee-460f-906e-40933665c5ad service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:32.746101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1084/2197] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:32 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:01:32.760391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50fc70-451a-41d9-84e9-4f278f48cfa6 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:32.829309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50fc70-451a-41d9-84e9-4f278f48cfa6 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:32.838402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:32.839399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.839900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.840236 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] PATH_INFO: `/v3/users/7c5ae8218f3241cf9598984043a38058` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.841792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5ae8218f3241cf9598984043a38058)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:32.844109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:32.895209 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5ae8218f3241cf9598984043a38058'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:32.896368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5ae8218f3241cf9598984043a38058'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:32.914171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5ae8218f3241cf9598984043a38058'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:32.914171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5ae8218f3241cf9598984043a38058'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:32.921955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5ae8218f3241cf9598984043a38058'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:32.950589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1114/2198] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:01:32 2022] DELETE /identity/v3/users/7c5ae8218f3241cf9598984043a38058 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:32.950799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221dc25-a16e-4b11-93a0-4030a80bbfdf None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:32.950799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221dc25-a16e-4b11-93a0-4030a80bbfdf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:32.950799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221dc25-a16e-4b11-93a0-4030a80bbfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:32.962280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b221dc25-a16e-4b11-93a0-4030a80bbfdf None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:32.963525 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b221dc25-a16e-4b11-93a0-4030a80bbfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:33.022590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1085/2199] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:01:33.032551 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:33.034555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:33.090565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4caa92-7862-4c56-9adf-b81b568eb039 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:33.094327 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61208a95-3fe3-4121-9bd2-43d064d5169d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:33.094963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61208a95-3fe3-4121-9bd2-43d064d5169d service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:33.095240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61208a95-3fe3-4121-9bd2-43d064d5169d service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:33.095516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61208a95-3fe3-4121-9bd2-43d064d5169d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:33.105082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61208a95-3fe3-4121-9bd2-43d064d5169d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:33.106562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61208a95-3fe3-4121-9bd2-43d064d5169d service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:33.117585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1115/2200] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:01:33.181478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c4d16-aa12-431a-a478-f7860a04a185 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:33.181936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c4d16-aa12-431a-a478-f7860a04a185 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:33.182316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c4d16-aa12-431a-a478-f7860a04a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:33.202789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-745c4d16-aa12-431a-a478-f7860a04a185 None None] MFA Rules not processed for user `e32c7724a2f74e0fa25b0f596be7c81b`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:33.204026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-745c4d16-aa12-431a-a478-f7860a04a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:33.271822 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1086/2201] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:33.430403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61208a95-3fe3-4121-9bd2-43d064d5169d service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:33.434828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-61208a95-3fe3-4121-9bd2-43d064d5169d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:33.457591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61208a95-3fe3-4121-9bd2-43d064d5169d service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:33.464465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:33.465775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:33.466285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:33.466626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] PATH_INFO: `/v3/projects/4fa932d156354a5b94ce28dfa22af61c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:33.468071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa932d156354a5b94ce28dfa22af61c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:33.471177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:33.537915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa932d156354a5b94ce28dfa22af61c', 'request_id': 'req-1b1c494f-22f4-4362-89c0-3823bfeba6ee'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:33.548825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa932d156354a5b94ce28dfa22af61c', 'request_id': 'req-1b1c494f-22f4-4362-89c0-3823bfeba6ee'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:33.559362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa932d156354a5b94ce28dfa22af61c', 'request_id': 'req-1b1c494f-22f4-4362-89c0-3823bfeba6ee'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:33.571218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] The token cache is being invalidate because project 4fa932d156354a5b94ce28dfa22af61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:01:33.571506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:33.572568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:01:33.585561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1116/2202] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:01:33 2022] DELETE /identity/v3/projects/4fa932d156354a5b94ce28dfa22af61c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:01:39.197071 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbb67d-d255-4fef-9f17-924c125fd8e6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:39.197622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbb67d-d255-4fef-9f17-924c125fd8e6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:39.198223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbb67d-d255-4fef-9f17-924c125fd8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:39.238969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8bdbb67d-d255-4fef-9f17-924c125fd8e6 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:39.240503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8bdbb67d-d255-4fef-9f17-924c125fd8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:39.313693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1087/2203] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 19:01:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:39.366325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:39.368825 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:39.446438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c494f-22f4-4362-89c0-3823bfeba6ee admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:39.451482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb1d17-ba79-4531-bac4-0b5f5149f37a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:39.452124 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb1d17-ba79-4531-bac4-0b5f5149f37a service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:39.452403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb1d17-ba79-4531-bac4-0b5f5149f37a service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:39.452675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb1d17-ba79-4531-bac4-0b5f5149f37a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:39.461422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb1d17-ba79-4531-bac4-0b5f5149f37a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:39.463048 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb1d17-ba79-4531-bac4-0b5f5149f37a service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:39.471308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1117/2204] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:01:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:01:57.224452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05857201-07e6-4878-b908-feec420611e8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:57.225055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05857201-07e6-4878-b908-feec420611e8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:57.225055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05857201-07e6-4878-b908-feec420611e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:57.244400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-05857201-07e6-4878-b908-feec420611e8 None None] MFA Rules not processed for user `1df4257419c4434fa22edb0805c1a204`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:57.245653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-05857201-07e6-4878-b908-feec420611e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:57.301439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1088/2205] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:01:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:58.615214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae9088-da76-40a6-8969-4b9e80746c4f None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:58.616139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae9088-da76-40a6-8969-4b9e80746c4f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:58.616586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae9088-da76-40a6-8969-4b9e80746c4f None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:58.618153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1118/2206] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 19:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 19:01:58.624523 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9750a-2dd4-4e39-8683-8bc25a090e3d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:58.625370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9750a-2dd4-4e39-8683-8bc25a090e3d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:58.625844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9750a-2dd4-4e39-8683-8bc25a090e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:58.695659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-16b9750a-2dd4-4e39-8683-8bc25a090e3d None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:58.697341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-16b9750a-2dd4-4e39-8683-8bc25a090e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:58.784821 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1089/2207] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 19:01:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:01:58.796557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae9088-da76-40a6-8969-4b9e80746c4f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:58.798416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0aae9088-da76-40a6-8969-4b9e80746c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:58.859498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae9088-da76-40a6-8969-4b9e80746c4f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:58.863074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd062-6f4b-4b03-9399-4f9900f63fe0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066d62c015e9483e87e4bd64ce8c4df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:58.863714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd062-6f4b-4b03-9399-4f9900f63fe0 service glance] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:58.863996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd062-6f4b-4b03-9399-4f9900f63fe0 service glance] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:58.864269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd062-6f4b-4b03-9399-4f9900f63fe0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:58.874344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cd062-6f4b-4b03-9399-4f9900f63fe0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:58.875778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cd062-6f4b-4b03-9399-4f9900f63fe0 service glance] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:58.886933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1119/2208] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:01:58.953397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c9d7e-c4ec-4151-a8ae-d32df56915bd None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:58.953687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c9d7e-c4ec-4151-a8ae-d32df56915bd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:58.953973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c9d7e-c4ec-4151-a8ae-d32df56915bd None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:58.955948 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1090/2209] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 19:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 19:01:58.960602 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fd77a-9ac8-4597-b999-655634e01763 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:58.960916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fd77a-9ac8-4597-b999-655634e01763 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:58.961195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fd77a-9ac8-4597-b999-655634e01763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:58.978316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6d6fd77a-9ac8-4597-b999-655634e01763 None None] MFA Rules not processed for user `41938583e61a45398e3e284c70204292`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:58.979557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6d6fd77a-9ac8-4597-b999-655634e01763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:59.030373 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1120/2210] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 19:01:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:59.042112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c9d7e-c4ec-4151-a8ae-d32df56915bd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:59.043888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5d1c9d7e-c4ec-4151-a8ae-d32df56915bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:59.057669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c9d7e-c4ec-4151-a8ae-d32df56915bd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:59.061215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c340b2-c62e-4809-b5f8-296aeb1b3570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:59.061887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c340b2-c62e-4809-b5f8-296aeb1b3570 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:59.062167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c340b2-c62e-4809-b5f8-296aeb1b3570 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:59.062442 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c340b2-c62e-4809-b5f8-296aeb1b3570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:59.070205 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c340b2-c62e-4809-b5f8-296aeb1b3570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:59.071630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c340b2-c62e-4809-b5f8-296aeb1b3570 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:59.079475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1091/2211] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:01:59.177176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc229f-c11b-449d-ba53-c45784a838ae None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:59.177609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc229f-c11b-449d-ba53-c45784a838ae None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:59.177971 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc229f-c11b-449d-ba53-c45784a838ae None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:59.180283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1121/2212] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 19:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 19:01:59.186747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a12b-e3b7-452f-98ae-7f1d8258903e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:59.187276 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a12b-e3b7-452f-98ae-7f1d8258903e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:59.187626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a12b-e3b7-452f-98ae-7f1d8258903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:59.223742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4566a12b-e3b7-452f-98ae-7f1d8258903e None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:59.225349 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4566a12b-e3b7-452f-98ae-7f1d8258903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:59.238310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1092/2213] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 19:01:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:59.252891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc229f-c11b-449d-ba53-c45784a838ae None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:59.255143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e0bc229f-c11b-449d-ba53-c45784a838ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:59.275060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc229f-c11b-449d-ba53-c45784a838ae None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:59.279755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271da4b-1cd7-458d-bf44-6edb8f001a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:59.280734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271da4b-1cd7-458d-bf44-6edb8f001a5c service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:59.281194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271da4b-1cd7-458d-bf44-6edb8f001a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:59.281715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271da4b-1cd7-458d-bf44-6edb8f001a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:59.298260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271da4b-1cd7-458d-bf44-6edb8f001a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:59.300345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271da4b-1cd7-458d-bf44-6edb8f001a5c service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:59.316949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd106-b529-4d40-b658-a0898c378e79 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:59.317475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd106-b529-4d40-b658-a0898c378e79 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:59.317802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd106-b529-4d40-b658-a0898c378e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:59.319524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1122/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:01:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:01:59.343770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-655cd106-b529-4d40-b658-a0898c378e79 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:01:59.345504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-655cd106-b529-4d40-b658-a0898c378e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:01:59.362159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1093/2215] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 19:01:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:01:59.369741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271da4b-1cd7-458d-bf44-6edb8f001a5c service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:01:59.390693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271da4b-1cd7-458d-bf44-6edb8f001a5c service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:01:59.396354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06694124-b4b9-47dd-a2bc-ceb44d0dd8f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:01:59.397397 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06694124-b4b9-47dd-a2bc-ceb44d0dd8f4 service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:01:59.397710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06694124-b4b9-47dd-a2bc-ceb44d0dd8f4 service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:01:59.397982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06694124-b4b9-47dd-a2bc-ceb44d0dd8f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:01:59.406658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06694124-b4b9-47dd-a2bc-ceb44d0dd8f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:01:59.408229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06694124-b4b9-47dd-a2bc-ceb44d0dd8f4 service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:01:59.417548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1123/2216] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:01:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:02:00.007017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1047e-bb7f-46cf-8d42-7aedef1a05e8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:00.007559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1047e-bb7f-46cf-8d42-7aedef1a05e8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:00.007713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1047e-bb7f-46cf-8d42-7aedef1a05e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:00.026696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-74e1047e-bb7f-46cf-8d42-7aedef1a05e8 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:02:00.027900 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-74e1047e-bb7f-46cf-8d42-7aedef1a05e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:00.041297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1094/2217] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 12 19:02:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:02:00.057735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06694124-b4b9-47dd-a2bc-ceb44d0dd8f4 service swift] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:02:00.067984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06694124-b4b9-47dd-a2bc-ceb44d0dd8f4 service swift] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:02:00.073036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4ce5b-ecf8-4b7d-94ee-9a302fe74302 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:02:00.073731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4ce5b-ecf8-4b7d-94ee-9a302fe74302 service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:00.074019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4ce5b-ecf8-4b7d-94ee-9a302fe74302 service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:00.074293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4ce5b-ecf8-4b7d-94ee-9a302fe74302 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:00.082858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4ce5b-ecf8-4b7d-94ee-9a302fe74302 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:02:00.084439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4ce5b-ecf8-4b7d-94ee-9a302fe74302 service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:02:00.092537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1124/2218] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:02:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:02:00.316691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60c203-b2bd-48f6-afb1-93f43c542cf8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:00.321932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60c203-b2bd-48f6-afb1-93f43c542cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:00.322497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60c203-b2bd-48f6-afb1-93f43c542cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:00.355454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0e60c203-b2bd-48f6-afb1-93f43c542cf8 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:02:00.356674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0e60c203-b2bd-48f6-afb1-93f43c542cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:00.371706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1095/2219] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 19:02:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:02:00.385973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4ce5b-ecf8-4b7d-94ee-9a302fe74302 service swift] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:02:00.399896 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4ce5b-ecf8-4b7d-94ee-9a302fe74302 service swift] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:02:00.405698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb6f29-37c1-4add-a231-fc6a1546e9d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:02:00.406627 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb6f29-37c1-4add-a231-fc6a1546e9d1 service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:00.407117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb6f29-37c1-4add-a231-fc6a1546e9d1 service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:00.407699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb6f29-37c1-4add-a231-fc6a1546e9d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:00.416954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb6f29-37c1-4add-a231-fc6a1546e9d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:02:00.418843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb6f29-37c1-4add-a231-fc6a1546e9d1 service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:02:00.427946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1125/2220] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:02:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:02:00.823767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30599049-908b-4a38-a4b4-6052c3d8232b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:00.824137 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30599049-908b-4a38-a4b4-6052c3d8232b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:00.824420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30599049-908b-4a38-a4b4-6052c3d8232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:00.856863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-30599049-908b-4a38-a4b4-6052c3d8232b None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:02:00.858168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-30599049-908b-4a38-a4b4-6052c3d8232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:00.868148 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1096/2221] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 12 19:02:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:02:00.884147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb6f29-37c1-4add-a231-fc6a1546e9d1 service swift] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:02:00.895670 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb6f29-37c1-4add-a231-fc6a1546e9d1 service swift] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:02:00.901880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5ec4e-387c-4f75-bdda-8e1d7b543e6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:02:00.902592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5ec4e-387c-4f75-bdda-8e1d7b543e6e service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:00.902946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5ec4e-387c-4f75-bdda-8e1d7b543e6e service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:00.903295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5ec4e-387c-4f75-bdda-8e1d7b543e6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:00.913491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5ec4e-387c-4f75-bdda-8e1d7b543e6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:02:00.915194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5ec4e-387c-4f75-bdda-8e1d7b543e6e service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:02:00.923439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1126/2222] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:02:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:02:03.082414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30599049-908b-4a38-a4b4-6052c3d8232b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:02:03.083830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-30599049-908b-4a38-a4b4-6052c3d8232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:03.147174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30599049-908b-4a38-a4b4-6052c3d8232b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:02:03.151630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:02:03.152487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:03.152769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:03.153043 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] PATH_INFO: `/v3/users/e32c7724a2f74e0fa25b0f596be7c81b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:03.154212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32c7724a2f74e0fa25b0f596be7c81b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:02:03.156154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:02:03.200385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32c7724a2f74e0fa25b0f596be7c81b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.212173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32c7724a2f74e0fa25b0f596be7c81b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.218727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32c7724a2f74e0fa25b0f596be7c81b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.219393 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32c7724a2f74e0fa25b0f596be7c81b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.227166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32c7724a2f74e0fa25b0f596be7c81b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.233426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1097/2223] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:02:03 2022] DELETE /identity/v3/users/e32c7724a2f74e0fa25b0f596be7c81b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:02:03.238692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a77f4f-f2d3-4e05-9e9d-3ea0657baa12 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:03.239158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a77f4f-f2d3-4e05-9e9d-3ea0657baa12 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:03.239251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a77f4f-f2d3-4e05-9e9d-3ea0657baa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:03.256040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d1a77f4f-f2d3-4e05-9e9d-3ea0657baa12 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:02:03.257218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d1a77f4f-f2d3-4e05-9e9d-3ea0657baa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:03.317845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1127/2224] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:02:03.327311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:02:03.328720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:03.388226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24271b9e-7687-492d-bb05-1535d35f7a6e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:02:03.391871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c03b5-1f5d-432e-88a2-0d571c8f1c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:02:03.392577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c03b5-1f5d-432e-88a2-0d571c8f1c47 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:03.392864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c03b5-1f5d-432e-88a2-0d571c8f1c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:03.393141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c03b5-1f5d-432e-88a2-0d571c8f1c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:03.402274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c03b5-1f5d-432e-88a2-0d571c8f1c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:02:03.403704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c03b5-1f5d-432e-88a2-0d571c8f1c47 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:02:03.413719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1098/2225] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:02:03.577316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a77f4f-f2d3-4e05-9e9d-3ea0657baa12 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:02:03.578799 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d1a77f4f-f2d3-4e05-9e9d-3ea0657baa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:03.591007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a77f4f-f2d3-4e05-9e9d-3ea0657baa12 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:02:03.596687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:02:03.597626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:03.598432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:03.598432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] PATH_INFO: `/v3/projects/b1e982ed51d9445b8f05cb7ddee40660` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:03.600060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e982ed51d9445b8f05cb7ddee40660)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:02:03.602038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:02:03.650622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e982ed51d9445b8f05cb7ddee40660', 'request_id': 'req-075b8f10-1b32-43b1-930f-d6bf0abeadc7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.660096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e982ed51d9445b8f05cb7ddee40660', 'request_id': 'req-075b8f10-1b32-43b1-930f-d6bf0abeadc7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.669496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e982ed51d9445b8f05cb7ddee40660', 'request_id': 'req-075b8f10-1b32-43b1-930f-d6bf0abeadc7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.681897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] The token cache is being invalidate because project b1e982ed51d9445b8f05cb7ddee40660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:02:03.682035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.684195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:02:03.686559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1128/2226] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:02:03 2022] DELETE /identity/v3/projects/b1e982ed51d9445b8f05cb7ddee40660 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:02:04.236195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720640b-0602-4b7c-a106-cca86419e713 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:04.237025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720640b-0602-4b7c-a106-cca86419e713 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:04.237308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720640b-0602-4b7c-a106-cca86419e713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:04.257230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d720640b-0602-4b7c-a106-cca86419e713 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:02:04.258489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d720640b-0602-4b7c-a106-cca86419e713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:04.313820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1099/2227] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 19:02:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:02:04.325583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:02:04.327089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:04.404501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b8f10-1b32-43b1-930f-d6bf0abeadc7 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:02:04.412969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0f169-e19b-4566-9832-e58040384479 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:02:04.414021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0f169-e19b-4566-9832-e58040384479 service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:04.414321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0f169-e19b-4566-9832-e58040384479 service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:04.414592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0f169-e19b-4566-9832-e58040384479 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:04.425875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0f169-e19b-4566-9832-e58040384479 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:02:04.428080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0f169-e19b-4566-9832-e58040384479 service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:02:04.437272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1129/2228] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:02:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:02:26.729858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d24203-6e17-440d-81be-a666d379ed05 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:26.730406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d24203-6e17-440d-81be-a666d379ed05 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:26.730406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d24203-6e17-440d-81be-a666d379ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:26.775500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-28d24203-6e17-440d-81be-a666d379ed05 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:02:26.776734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-28d24203-6e17-440d-81be-a666d379ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:26.793994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1100/2229] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 12 19:02:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:02:26.806469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0f169-e19b-4566-9832-e58040384479 service swift] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:02:26.825751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0f169-e19b-4566-9832-e58040384479 service swift] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:02:26.831197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec54ea-650e-4fe8-8a1b-33241d14df63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:02:26.831848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec54ea-650e-4fe8-8a1b-33241d14df63 service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:26.832124 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec54ea-650e-4fe8-8a1b-33241d14df63 service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:26.832394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec54ea-650e-4fe8-8a1b-33241d14df63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:26.840703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec54ea-650e-4fe8-8a1b-33241d14df63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:02:26.842357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec54ea-650e-4fe8-8a1b-33241d14df63 service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:02:26.850869 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1130/2230] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:02:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:02:36.998543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d24203-6e17-440d-81be-a666d379ed05 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:02:37.000674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-28d24203-6e17-440d-81be-a666d379ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:37.092160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d24203-6e17-440d-81be-a666d379ed05 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:02:37.097139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe06692-b460-4d74-8cf2-ec51c15e895f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf772e34d8f14923bb9c1fe883fd3926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:02:37.097810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe06692-b460-4d74-8cf2-ec51c15e895f service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:37.098089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe06692-b460-4d74-8cf2-ec51c15e895f service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:37.098360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe06692-b460-4d74-8cf2-ec51c15e895f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:37.100299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8fe06692-b460-4d74-8cf2-ec51c15e895f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:37.112073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe06692-b460-4d74-8cf2-ec51c15e895f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:02:37.113855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe06692-b460-4d74-8cf2-ec51c15e895f service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:02:37.124346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1101/2231] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:02:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:02:46.192985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc0c6f-1592-4b2d-834d-15d19f2b73cb None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:02:46.193513 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc0c6f-1592-4b2d-834d-15d19f2b73cb None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:02:46.193664 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc0c6f-1592-4b2d-834d-15d19f2b73cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:02:46.211255 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9fbc0c6f-1592-4b2d-834d-15d19f2b73cb None None] MFA Rules not processed for user `e1ebd0110fff4620b11e881c90470cda`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:02:46.212452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9fbc0c6f-1592-4b2d-834d-15d19f2b73cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:02:46.263650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1131/2232] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:02:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:03:18.847637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00283c1a-1fad-4bcd-88e7-6197a6b37c44 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:03:18.848147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00283c1a-1fad-4bcd-88e7-6197a6b37c44 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:03:18.848260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00283c1a-1fad-4bcd-88e7-6197a6b37c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:03:18.865257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-00283c1a-1fad-4bcd-88e7-6197a6b37c44 None None] MFA Rules not processed for user `803b29a8c5e34ef0993913c0b08ccfd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:03:18.866517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00283c1a-1fad-4bcd-88e7-6197a6b37c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:03:18.922853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1102/2233] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:03:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:03:39.412508 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a475c3-0121-4e7d-b52c-e6c115f4a403 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:03:39.413038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a475c3-0121-4e7d-b52c-e6c115f4a403 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:03:39.413038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a475c3-0121-4e7d-b52c-e6c115f4a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:03:39.429911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-80a475c3-0121-4e7d-b52c-e6c115f4a403 None None] MFA Rules not processed for user `1df4257419c4434fa22edb0805c1a204`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:03:39.431088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-80a475c3-0121-4e7d-b52c-e6c115f4a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:03:39.483285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1132/2234] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:03:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:03:53.574320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ece6b-f402-4e71-b458-6f86490a3a8f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:03:53.574890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ece6b-f402-4e71-b458-6f86490a3a8f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:03:53.574890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ece6b-f402-4e71-b458-6f86490a3a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:03:53.593126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-474ece6b-f402-4e71-b458-6f86490a3a8f None None] MFA Rules not processed for user `e1ebd0110fff4620b11e881c90470cda`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:03:53.594380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-474ece6b-f402-4e71-b458-6f86490a3a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:03:53.601226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1103/2235] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:03:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:03.602348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da497-b4d5-4186-a8c8-30fdacf16a19 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:03.602883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da497-b4d5-4186-a8c8-30fdacf16a19 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:03.602883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da497-b4d5-4186-a8c8-30fdacf16a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:03.620293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2f2da497-b4d5-4186-a8c8-30fdacf16a19 None None] MFA Rules not processed for user `2c202a7f2c484cd3b0363b75c1a673a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:03.622054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2f2da497-b4d5-4186-a8c8-30fdacf16a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:03.675180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1133/2236] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:04:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:17.422482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ece6b-f402-4e71-b458-6f86490a3a8f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:17.423961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-474ece6b-f402-4e71-b458-6f86490a3a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:17.504915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ece6b-f402-4e71-b458-6f86490a3a8f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:17.508429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f899f2-363b-4cf0-813a-152b691431ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066d62c015e9483e87e4bd64ce8c4df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:17.509066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f899f2-363b-4cf0-813a-152b691431ef service glance] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:17.509343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f899f2-363b-4cf0-813a-152b691431ef service glance] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:17.509642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f899f2-363b-4cf0-813a-152b691431ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:17.511423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-08f899f2-363b-4cf0-813a-152b691431ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:17.581763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f899f2-363b-4cf0-813a-152b691431ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:17.583210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f899f2-363b-4cf0-813a-152b691431ef service glance] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:17.594576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1104/2237] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:19.108277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da497-b4d5-4186-a8c8-30fdacf16a19 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:19.110143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2f2da497-b4d5-4186-a8c8-30fdacf16a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:19.175023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da497-b4d5-4186-a8c8-30fdacf16a19 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:19.178567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c58c-24ad-47f2-a5a7-a543c1516f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:19.179212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c58c-24ad-47f2-a5a7-a543c1516f2b service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:19.179489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c58c-24ad-47f2-a5a7-a543c1516f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:19.179762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c58c-24ad-47f2-a5a7-a543c1516f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:19.181556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1a71c58c-24ad-47f2-a5a7-a543c1516f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:19.195603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71c58c-24ad-47f2-a5a7-a543c1516f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:19.197392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71c58c-24ad-47f2-a5a7-a543c1516f2b service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:19.208890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1134/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:36.747279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f899f2-363b-4cf0-813a-152b691431ef service glance] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:36.756498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f899f2-363b-4cf0-813a-152b691431ef service glance] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:36.760103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c94a2f-714b-4ef9-b48e-e551ff4b3ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:36.760730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c94a2f-714b-4ef9-b48e-e551ff4b3ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:36.761014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c94a2f-714b-4ef9-b48e-e551ff4b3ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:36.761293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c94a2f-714b-4ef9-b48e-e551ff4b3ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:36.764418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d6c94a2f-714b-4ef9-b48e-e551ff4b3ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:36.775484 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c94a2f-714b-4ef9-b48e-e551ff4b3ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:36.776913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c94a2f-714b-4ef9-b48e-e551ff4b3ee9 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:36.786932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1105/2239] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:37.220244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955228e-403e-4193-9f05-0a532342c5b5 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:37.220775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955228e-403e-4193-9f05-0a532342c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:37.220857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955228e-403e-4193-9f05-0a532342c5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:37.239082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4955228e-403e-4193-9f05-0a532342c5b5 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:37.240313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4955228e-403e-4193-9f05-0a532342c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:37.247691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1135/2240] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:37.300692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c94a2f-714b-4ef9-b48e-e551ff4b3ee9 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:37.317427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c94a2f-714b-4ef9-b48e-e551ff4b3ee9 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:37.323451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569db9b-3983-4d38-8716-f64a1caa47a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:37.324341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569db9b-3983-4d38-8716-f64a1caa47a6 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:37.324706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569db9b-3983-4d38-8716-f64a1caa47a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:37.325088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569db9b-3983-4d38-8716-f64a1caa47a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:37.337329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569db9b-3983-4d38-8716-f64a1caa47a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:37.339812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569db9b-3983-4d38-8716-f64a1caa47a6 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:37.371403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1106/2241] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:04:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 19:04:44.797888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955228e-403e-4193-9f05-0a532342c5b5 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:44.808375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955228e-403e-4193-9f05-0a532342c5b5 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:44.812117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f2779-7708-4bd6-b2be-c41e84d71736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:44.812768 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f2779-7708-4bd6-b2be-c41e84d71736 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:44.813046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f2779-7708-4bd6-b2be-c41e84d71736 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:44.813316 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f2779-7708-4bd6-b2be-c41e84d71736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:44.815311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d65f2779-7708-4bd6-b2be-c41e84d71736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:44.887141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f2779-7708-4bd6-b2be-c41e84d71736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:44.888582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f2779-7708-4bd6-b2be-c41e84d71736 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:44.898977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1136/2242] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:45.470159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569db9b-3983-4d38-8716-f64a1caa47a6 service swift] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:45.472343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0569db9b-3983-4d38-8716-f64a1caa47a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:45.491151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569db9b-3983-4d38-8716-f64a1caa47a6 service swift] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:45.502687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a350-997c-41b0-824c-c381360be825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:45.503359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a350-997c-41b0-824c-c381360be825 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:45.503639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a350-997c-41b0-824c-c381360be825 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:45.503911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a350-997c-41b0-824c-c381360be825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:45.505840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b239a350-997c-41b0-824c-c381360be825 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:45.518239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239a350-997c-41b0-824c-c381360be825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:45.519990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239a350-997c-41b0-824c-c381360be825 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:45.532714 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1107/2243] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:47.285934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f2779-7708-4bd6-b2be-c41e84d71736 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:47.295110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f2779-7708-4bd6-b2be-c41e84d71736 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:47.299311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268ca09-0df1-4b3c-bb9e-9e55bc47e540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:47.300060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268ca09-0df1-4b3c-bb9e-9e55bc47e540 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:47.300579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268ca09-0df1-4b3c-bb9e-9e55bc47e540 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:47.301074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268ca09-0df1-4b3c-bb9e-9e55bc47e540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:47.303066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0268ca09-0df1-4b3c-bb9e-9e55bc47e540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:47.315926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268ca09-0df1-4b3c-bb9e-9e55bc47e540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:47.318356 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268ca09-0df1-4b3c-bb9e-9e55bc47e540 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:47.328633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1137/2244] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:49.160658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a350-997c-41b0-824c-c381360be825 service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:49.164189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b239a350-997c-41b0-824c-c381360be825 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:49.178185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a350-997c-41b0-824c-c381360be825 service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:49.182710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:49.184093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.184374 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.184648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] PATH_INFO: `/v3/users/1df4257419c4434fa22edb0805c1a204` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.185859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df4257419c4434fa22edb0805c1a204)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:49.187869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:49.231875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df4257419c4434fa22edb0805c1a204'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.243134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df4257419c4434fa22edb0805c1a204'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.249709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df4257419c4434fa22edb0805c1a204'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.250361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df4257419c4434fa22edb0805c1a204'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.257379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d3b61a75-d9e9-4867-b720-7458809fc8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df4257419c4434fa22edb0805c1a204'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.263399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1108/2245] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:04:49 2022] DELETE /identity/v3/users/1df4257419c4434fa22edb0805c1a204 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:04:49.434058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268ca09-0df1-4b3c-bb9e-9e55bc47e540 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:49.445982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268ca09-0df1-4b3c-bb9e-9e55bc47e540 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:49.502762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:49.503623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.503905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.504179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] PATH_INFO: `/v3/projects/eb2e124562e34719a49be3de45e6cf37` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.505349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2e124562e34719a49be3de45e6cf37)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:49.507271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:49.551668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2e124562e34719a49be3de45e6cf37', 'request_id': 'req-2a535fd6-c726-466f-a793-74e3f2ac67ee'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.558999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2e124562e34719a49be3de45e6cf37', 'request_id': 'req-2a535fd6-c726-466f-a793-74e3f2ac67ee'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.564850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2e124562e34719a49be3de45e6cf37', 'request_id': 'req-2a535fd6-c726-466f-a793-74e3f2ac67ee'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.575471 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] The token cache is being invalidate because project eb2e124562e34719a49be3de45e6cf37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:04:49.575764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.576414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2a535fd6-c726-466f-a793-74e3f2ac67ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:49.578030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1138/2246] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:04:49 2022] DELETE /identity/v3/projects/eb2e124562e34719a49be3de45e6cf37 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:04:49.583007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4d484-c59b-4e15-95d6-5a657f3bc87a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.583324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4d484-c59b-4e15-95d6-5a657f3bc87a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.583605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4d484-c59b-4e15-95d6-5a657f3bc87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.601510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7fd4d484-c59b-4e15-95d6-5a657f3bc87a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:49.602813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7fd4d484-c59b-4e15-95d6-5a657f3bc87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:49.662093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1109/2247] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:49.669623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b0a5-0a4e-48dc-960f-d7cd92fe7095 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.669917 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b0a5-0a4e-48dc-960f-d7cd92fe7095 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.670196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b0a5-0a4e-48dc-960f-d7cd92fe7095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.688194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1990b0a5-0a4e-48dc-960f-d7cd92fe7095 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:49.689395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1990b0a5-0a4e-48dc-960f-d7cd92fe7095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:49.697288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1139/2248] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:49.701993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4d484-c59b-4e15-95d6-5a657f3bc87a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:49.712485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4d484-c59b-4e15-95d6-5a657f3bc87a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:49.718891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90b18e-1ba7-4539-bf44-4c3b9f94df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:49.719553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b18e-1ba7-4539-bf44-4c3b9f94df02 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.719837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b18e-1ba7-4539-bf44-4c3b9f94df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.720113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b18e-1ba7-4539-bf44-4c3b9f94df02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.720849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b18e-1ba7-4539-bf44-4c3b9f94df02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:04:49.721161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b18e-1ba7-4539-bf44-4c3b9f94df02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:49.723227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b18e-1ba7-4539-bf44-4c3b9f94df02 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:49.734453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1110/2249] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:04:49.738552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990b0a5-0a4e-48dc-960f-d7cd92fe7095 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:49.747687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990b0a5-0a4e-48dc-960f-d7cd92fe7095 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:49.752317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44eb56-4039-45ec-a300-54e13669202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:49.752950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44eb56-4039-45ec-a300-54e13669202c admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.753385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44eb56-4039-45ec-a300-54e13669202c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.753667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44eb56-4039-45ec-a300-54e13669202c admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.754236 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44eb56-4039-45ec-a300-54e13669202c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:49.756110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44eb56-4039-45ec-a300-54e13669202c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:49.786566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1140/2250] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:04:49 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:04:49.788008 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90b18e-1ba7-4539-bf44-4c3b9f94df02 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:49.797928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90b18e-1ba7-4539-bf44-4c3b9f94df02 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:49.854078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f19846-419d-4356-8460-d99bcd9b7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:49.854670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f19846-419d-4356-8460-d99bcd9b7e14 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.854958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f19846-419d-4356-8460-d99bcd9b7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.855238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f19846-419d-4356-8460-d99bcd9b7e14 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.855927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f19846-419d-4356-8460-d99bcd9b7e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:49.858053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f19846-419d-4356-8460-d99bcd9b7e14 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:49.877762 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1111/2251] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:04:49 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:04:49.881699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44eb56-4039-45ec-a300-54e13669202c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:49.892561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44eb56-4039-45ec-a300-54e13669202c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:49.897329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55fdc4-a51d-4040-b058-f82f3b12c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:49.898030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55fdc4-a51d-4040-b058-f82f3b12c742 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.898314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55fdc4-a51d-4040-b058-f82f3b12c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.898587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55fdc4-a51d-4040-b058-f82f3b12c742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.899304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55fdc4-a51d-4040-b058-f82f3b12c742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:49.900894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55fdc4-a51d-4040-b058-f82f3b12c742 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:49.912258 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1141/2252] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:04:49.916275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f19846-419d-4356-8460-d99bcd9b7e14 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:49.926044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f19846-419d-4356-8460-d99bcd9b7e14 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:49.930526 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea40dbf-96c0-4a10-ac97-69332b8f07ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:49.931164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea40dbf-96c0-4a10-ac97-69332b8f07ea admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.931440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea40dbf-96c0-4a10-ac97-69332b8f07ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.931710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea40dbf-96c0-4a10-ac97-69332b8f07ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.932427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea40dbf-96c0-4a10-ac97-69332b8f07ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:49.934537 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea40dbf-96c0-4a10-ac97-69332b8f07ea admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:49.944025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1112/2253] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:04:49.947991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55fdc4-a51d-4040-b058-f82f3b12c742 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:49.958111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55fdc4-a51d-4040-b058-f82f3b12c742 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:49.962638 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8cfb5-f05f-4cc3-8d80-85696c1c4907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:49.963500 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8cfb5-f05f-4cc3-8d80-85696c1c4907 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:49.963778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8cfb5-f05f-4cc3-8d80-85696c1c4907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:49.964049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8cfb5-f05f-4cc3-8d80-85696c1c4907 admin admin] PATH_INFO: `/v3/projects/cf3cff5264994280a73b27f733497d99/users/77fe4509d4c140cb94b4dc18adc60b85/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:49.978059 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8cfb5-f05f-4cc3-8d80-85696c1c4907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3cff5264994280a73b27f733497d99, user_id=77fe4509d4c140cb94b4dc18adc60b85, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:49.980687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8cfb5-f05f-4cc3-8d80-85696c1c4907 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:49.992965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1142/2254] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:04:49 2022] PUT /identity/v3/projects/cf3cff5264994280a73b27f733497d99/users/77fe4509d4c140cb94b4dc18adc60b85/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:04:50.003256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300acb8-139b-4f59-83a9-5acb2e002fb6 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:50.003551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300acb8-139b-4f59-83a9-5acb2e002fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:50.003831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300acb8-139b-4f59-83a9-5acb2e002fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:50.029674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6300acb8-139b-4f59-83a9-5acb2e002fb6 None None] MFA Rules not processed for user `77fe4509d4c140cb94b4dc18adc60b85`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:50.030906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6300acb8-139b-4f59-83a9-5acb2e002fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:50.091759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1113/2255] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:04:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:04:50.102639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8cfb5-f05f-4cc3-8d80-85696c1c4907 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:50.104357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-87f8cfb5-f05f-4cc3-8d80-85696c1c4907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:50.181830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8cfb5-f05f-4cc3-8d80-85696c1c4907 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:50.188880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3749a-a1e5-4b42-a453-363a65bded06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:50.189639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3749a-a1e5-4b42-a453-363a65bded06 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:50.189950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3749a-a1e5-4b42-a453-363a65bded06 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:50.190228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3749a-a1e5-4b42-a453-363a65bded06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:50.198422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3749a-a1e5-4b42-a453-363a65bded06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:50.200553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3749a-a1e5-4b42-a453-363a65bded06 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:50.209189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1143/2256] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:51.678927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300acb8-139b-4f59-83a9-5acb2e002fb6 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:51.680601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6300acb8-139b-4f59-83a9-5acb2e002fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:51.743119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300acb8-139b-4f59-83a9-5acb2e002fb6 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:51.747304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e75b4b-aa35-40ea-98fd-5ec0373d7b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:51.747949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75b4b-aa35-40ea-98fd-5ec0373d7b4f service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:51.748235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75b4b-aa35-40ea-98fd-5ec0373d7b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:51.748514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75b4b-aa35-40ea-98fd-5ec0373d7b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:51.750318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-61e75b4b-aa35-40ea-98fd-5ec0373d7b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:51.759652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e75b4b-aa35-40ea-98fd-5ec0373d7b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:51.761110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e75b4b-aa35-40ea-98fd-5ec0373d7b4f service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:51.769884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1114/2257] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:51.884840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159ade3-3786-45cc-ae16-1d60a8788a51 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:51.885336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159ade3-3786-45cc-ae16-1d60a8788a51 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:51.885480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159ade3-3786-45cc-ae16-1d60a8788a51 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:51.886993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1144/2258] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 19:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 19:04:51.893019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021acd54-6a06-4a5d-b5e6-21c96d045721 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:51.893316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021acd54-6a06-4a5d-b5e6-21c96d045721 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:51.893626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021acd54-6a06-4a5d-b5e6-21c96d045721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:51.916002 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-021acd54-6a06-4a5d-b5e6-21c96d045721 None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:51.917212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-021acd54-6a06-4a5d-b5e6-21c96d045721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:51.928088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1115/2259] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:51.940491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159ade3-3786-45cc-ae16-1d60a8788a51 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:51.942232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3159ade3-3786-45cc-ae16-1d60a8788a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:51.999971 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159ade3-3786-45cc-ae16-1d60a8788a51 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:52.003779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee5596-a2dd-4b26-b18d-6d4afe9747ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066d62c015e9483e87e4bd64ce8c4df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:52.004587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee5596-a2dd-4b26-b18d-6d4afe9747ad service glance] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:52.004875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee5596-a2dd-4b26-b18d-6d4afe9747ad service glance] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:52.005152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee5596-a2dd-4b26-b18d-6d4afe9747ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:52.016250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee5596-a2dd-4b26-b18d-6d4afe9747ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:52.017724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee5596-a2dd-4b26-b18d-6d4afe9747ad service glance] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:52.029421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1145/2260] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:52.094067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0f707-07a4-4df8-af34-3f96994c6335 None None] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:52.094358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0f707-07a4-4df8-af34-3f96994c6335 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:52.094636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0f707-07a4-4df8-af34-3f96994c6335 None None] PATH_INFO: `/` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:52.096010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1116/2261] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 19:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 19:04:52.100766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba360d6-c514-470e-a920-96ac6affd6a8 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:52.101051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba360d6-c514-470e-a920-96ac6affd6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:52.101330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba360d6-c514-470e-a920-96ac6affd6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:52.119535 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6ba360d6-c514-470e-a920-96ac6affd6a8 None None] MFA Rules not processed for user `41938583e61a45398e3e284c70204292`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:52.120753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6ba360d6-c514-470e-a920-96ac6affd6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:52.128342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1146/2262] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:52.139757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0f707-07a4-4df8-af34-3f96994c6335 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:52.150528 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0f707-07a4-4df8-af34-3f96994c6335 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:52.154584 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a394d08-372a-43a1-82a7-7ec1121427c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:52.155205 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a394d08-372a-43a1-82a7-7ec1121427c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:52.155492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a394d08-372a-43a1-82a7-7ec1121427c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:52.155766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a394d08-372a-43a1-82a7-7ec1121427c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:52.162855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a394d08-372a-43a1-82a7-7ec1121427c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:52.164283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a394d08-372a-43a1-82a7-7ec1121427c9 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:52.172855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1117/2263] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:52.252712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0611-5da0-4526-9487-44fc9131f193 None None] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:52.253003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0611-5da0-4526-9487-44fc9131f193 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:52.253282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0611-5da0-4526-9487-44fc9131f193 None None] PATH_INFO: `/` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:52.254762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1147/2264] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 12 19:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 19:04:52.259922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dcbad-7d37-45cc-8b65-1729f6c543f3 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:52.260215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dcbad-7d37-45cc-8b65-1729f6c543f3 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:52.260492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dcbad-7d37-45cc-8b65-1729f6c543f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:52.280621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-f58dcbad-7d37-45cc-8b65-1729f6c543f3 None None] MFA Rules not processed for user `e2e41b41f355446c8462fafcd91c183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:52.282159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f58dcbad-7d37-45cc-8b65-1729f6c543f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:52.292277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1118/2265] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 12 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:52.303387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f0611-5da0-4526-9487-44fc9131f193 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:52.314754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f0611-5da0-4526-9487-44fc9131f193 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:52.318570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61baa-5e30-47d5-a774-bd8d01c1a59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:52.319384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61baa-5e30-47d5-a774-bd8d01c1a59c service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:52.319663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61baa-5e30-47d5-a774-bd8d01c1a59c service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:52.319937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61baa-5e30-47d5-a774-bd8d01c1a59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:52.330760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61baa-5e30-47d5-a774-bd8d01c1a59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:52.332195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61baa-5e30-47d5-a774-bd8d01c1a59c service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:52.345562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1148/2266] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:52.407018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dcbad-7d37-45cc-8b65-1729f6c543f3 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:52.408526 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f58dcbad-7d37-45cc-8b65-1729f6c543f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:52.475939 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dcbad-7d37-45cc-8b65-1729f6c543f3 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:52.481750 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b15cea-0fde-464c-a2cc-8a7c1c47acf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf772e34d8f14923bb9c1fe883fd3926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:52.482397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b15cea-0fde-464c-a2cc-8a7c1c47acf4 service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:52.482818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b15cea-0fde-464c-a2cc-8a7c1c47acf4 service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:52.483096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b15cea-0fde-464c-a2cc-8a7c1c47acf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:52.484849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-82b15cea-0fde-464c-a2cc-8a7c1c47acf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:52.497358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b15cea-0fde-464c-a2cc-8a7c1c47acf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:52.498980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b15cea-0fde-464c-a2cc-8a7c1c47acf4 service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:52.509051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1119/2267] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:53.098355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61baa-5e30-47d5-a774-bd8d01c1a59c service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:53.109640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61baa-5e30-47d5-a774-bd8d01c1a59c service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:53.115106 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:53.115742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:53.116024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:53.116297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:53.118109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:53.178780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:53.180381 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:53.190272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1149/2268] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:56.028196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80c459-cbf9-4812-9784-388d75b74d16 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:56.028666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80c459-cbf9-4812-9784-388d75b74d16 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:56.028884 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80c459-cbf9-4812-9784-388d75b74d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:56.047108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0b80c459-cbf9-4812-9784-388d75b74d16 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:56.048382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0b80c459-cbf9-4812-9784-388d75b74d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:56.102271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1120/2269] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 19:04:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:56.115378 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:56.116755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:56.197152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6cfaf-0df0-4840-b152-6bd3e5532ecc service nova] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:56.205762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80951184-4a18-463b-9d4f-663ee4a05d0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:56.205929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80951184-4a18-463b-9d4f-663ee4a05d0c service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:56.206222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80951184-4a18-463b-9d4f-663ee4a05d0c service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:56.206488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80951184-4a18-463b-9d4f-663ee4a05d0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:56.215741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80951184-4a18-463b-9d4f-663ee4a05d0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:56.217310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80951184-4a18-463b-9d4f-663ee4a05d0c service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:56.225390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1150/2270] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:04:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:04:57.547470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80c459-cbf9-4812-9784-388d75b74d16 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:57.606445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80c459-cbf9-4812-9784-388d75b74d16 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:57.610941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:57.611788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:57.612078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:57.612353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] PATH_INFO: `/v3/users/77fe4509d4c140cb94b4dc18adc60b85` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:57.613565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fe4509d4c140cb94b4dc18adc60b85)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:57.615500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:57.666402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fe4509d4c140cb94b4dc18adc60b85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:57.679878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fe4509d4c140cb94b4dc18adc60b85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:57.687800 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fe4509d4c140cb94b4dc18adc60b85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:57.688871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fe4509d4c140cb94b4dc18adc60b85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:57.700119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fe4509d4c140cb94b4dc18adc60b85'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:57.707382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1121/2271] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:04:57 2022] DELETE /identity/v3/users/77fe4509d4c140cb94b4dc18adc60b85 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:04:57.712043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dce88-0d71-475a-9b46-165418dbbb30 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:57.712519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dce88-0d71-475a-9b46-165418dbbb30 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:57.712792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dce88-0d71-475a-9b46-165418dbbb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:57.747058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f94dce88-0d71-475a-9b46-165418dbbb30 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:57.748402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f94dce88-0d71-475a-9b46-165418dbbb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:57.795626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:57.797078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:57.808959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1151/2272] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:57.818431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dce88-0d71-475a-9b46-165418dbbb30 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:57.819750 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f94dce88-0d71-475a-9b46-165418dbbb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:57.871414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306dd6-ec56-4c56-bf04-911078a32863 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:57.877230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3fbcd-4326-42bf-a6af-da7ec4fa4079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:57.877907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3fbcd-4326-42bf-a6af-da7ec4fa4079 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:57.878187 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3fbcd-4326-42bf-a6af-da7ec4fa4079 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:57.878463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3fbcd-4326-42bf-a6af-da7ec4fa4079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:57.878669 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dce88-0d71-475a-9b46-165418dbbb30 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:57.880212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9ce3fbcd-4326-42bf-a6af-da7ec4fa4079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:57.882352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cb508-1001-4dd1-b7e3-04b7ef5ce51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:57.882995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cb508-1001-4dd1-b7e3-04b7ef5ce51b service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:57.883276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cb508-1001-4dd1-b7e3-04b7ef5ce51b service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:57.883555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cb508-1001-4dd1-b7e3-04b7ef5ce51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:57.895060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cb508-1001-4dd1-b7e3-04b7ef5ce51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:57.896496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cb508-1001-4dd1-b7e3-04b7ef5ce51b service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:57.907348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1152/2273] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:04:57.955075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3fbcd-4326-42bf-a6af-da7ec4fa4079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:57.957142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3fbcd-4326-42bf-a6af-da7ec4fa4079 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:57.968161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1122/2274] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:04:58.370141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cb508-1001-4dd1-b7e3-04b7ef5ce51b service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:58.372390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e76cb508-1001-4dd1-b7e3-04b7ef5ce51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:58.414794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cb508-1001-4dd1-b7e3-04b7ef5ce51b service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:58.427275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:58.429457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:58.429797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:58.430113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] PATH_INFO: `/v3/projects/cf3cff5264994280a73b27f733497d99` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:58.434354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3cff5264994280a73b27f733497d99)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:58.438350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:58.501897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3cff5264994280a73b27f733497d99', 'request_id': 'req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:58.510513 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3cff5264994280a73b27f733497d99', 'request_id': 'req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:58.517923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3cff5264994280a73b27f733497d99', 'request_id': 'req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:58.528301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] The token cache is being invalidate because project cf3cff5264994280a73b27f733497d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:04:58.528590 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:58.529219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8bc6ff83-30f0-47f5-805c-8951a5d8bb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:04:58.531333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1153/2275] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:04:58 2022] DELETE /identity/v3/projects/cf3cff5264994280a73b27f733497d99 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:04:58.536492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8bf07-3872-43e2-a564-d3ebbda2c759 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:58.536766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8bf07-3872-43e2-a564-d3ebbda2c759 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:58.537044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8bf07-3872-43e2-a564-d3ebbda2c759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:58.555591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-29c8bf07-3872-43e2-a564-d3ebbda2c759 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:58.556818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-29c8bf07-3872-43e2-a564-d3ebbda2c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:58.621289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1123/2276] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:58.629822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08cd5-6414-419c-8a21-1849e70fade7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:58.630196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08cd5-6414-419c-8a21-1849e70fade7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:58.630553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08cd5-6414-419c-8a21-1849e70fade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:58.658328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-8ed08cd5-6414-419c-8a21-1849e70fade7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:58.660049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8ed08cd5-6414-419c-8a21-1849e70fade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:58.669085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1154/2277] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:58.673329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8bf07-3872-43e2-a564-d3ebbda2c759 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:58.683119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8bf07-3872-43e2-a564-d3ebbda2c759 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:58.687868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292578ec-f78f-4657-9ccf-0f55190ae302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:58.688744 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292578ec-f78f-4657-9ccf-0f55190ae302 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:58.689213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292578ec-f78f-4657-9ccf-0f55190ae302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:58.689681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292578ec-f78f-4657-9ccf-0f55190ae302 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:58.690598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292578ec-f78f-4657-9ccf-0f55190ae302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:04:58.690915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292578ec-f78f-4657-9ccf-0f55190ae302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:58.692512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292578ec-f78f-4657-9ccf-0f55190ae302 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:58.705364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1124/2278] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:04:58.709654 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed08cd5-6414-419c-8a21-1849e70fade7 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:58.720557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed08cd5-6414-419c-8a21-1849e70fade7 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:58.725147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760254d-b139-4ef5-91f3-173c25656ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:58.725836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760254d-b139-4ef5-91f3-173c25656ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:58.726116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760254d-b139-4ef5-91f3-173c25656ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:58.726389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760254d-b139-4ef5-91f3-173c25656ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:58.727108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760254d-b139-4ef5-91f3-173c25656ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:58.729012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760254d-b139-4ef5-91f3-173c25656ec6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:58.754312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1155/2279] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:04:58 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:04:58.758642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292578ec-f78f-4657-9ccf-0f55190ae302 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:58.769239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292578ec-f78f-4657-9ccf-0f55190ae302 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:58.843833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be022a-ca4e-4fc5-a625-cb27c33a7562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:58.845257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be022a-ca4e-4fc5-a625-cb27c33a7562 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:58.845888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be022a-ca4e-4fc5-a625-cb27c33a7562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:58.846423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be022a-ca4e-4fc5-a625-cb27c33a7562 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:58.847418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be022a-ca4e-4fc5-a625-cb27c33a7562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:58.849673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be022a-ca4e-4fc5-a625-cb27c33a7562 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:58.879971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1125/2280] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:04:58 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:04:58.881374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760254d-b139-4ef5-91f3-173c25656ec6 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:58.892728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760254d-b139-4ef5-91f3-173c25656ec6 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:58.897565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cb4b7-1652-4426-912f-8ef455d0af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:58.901102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cb4b7-1652-4426-912f-8ef455d0af0c admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:58.901492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cb4b7-1652-4426-912f-8ef455d0af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:58.901898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cb4b7-1652-4426-912f-8ef455d0af0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:58.902761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cb4b7-1652-4426-912f-8ef455d0af0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:58.904365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cb4b7-1652-4426-912f-8ef455d0af0c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:58.916154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1156/2281] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:04:58.920363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be022a-ca4e-4fc5-a625-cb27c33a7562 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:58.930256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be022a-ca4e-4fc5-a625-cb27c33a7562 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:58.935864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6e073-4b6d-481c-8f95-9378e58d9533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:58.936668 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e073-4b6d-481c-8f95-9378e58d9533 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:58.936993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e073-4b6d-481c-8f95-9378e58d9533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:58.937477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e073-4b6d-481c-8f95-9378e58d9533 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:58.938279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6e073-4b6d-481c-8f95-9378e58d9533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:58.940304 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6e073-4b6d-481c-8f95-9378e58d9533 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:58.951783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1126/2282] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:04:58.956030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cb4b7-1652-4426-912f-8ef455d0af0c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:58.965758 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cb4b7-1652-4426-912f-8ef455d0af0c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:58.970323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc1a2-0962-4ca7-b726-baf06965889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:58.971231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc1a2-0962-4ca7-b726-baf06965889b admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:58.971450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc1a2-0962-4ca7-b726-baf06965889b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:58.971716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc1a2-0962-4ca7-b726-baf06965889b admin admin] PATH_INFO: `/v3/projects/e39a9deb216848648f9f468edc17ba7a/users/45a468e95e674149bbcae8c56744fa04/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:58.985952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cc1a2-0962-4ca7-b726-baf06965889b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39a9deb216848648f9f468edc17ba7a, user_id=45a468e95e674149bbcae8c56744fa04, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:58.988686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cc1a2-0962-4ca7-b726-baf06965889b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:59.029577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1157/2283] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:04:58 2022] PUT /identity/v3/projects/e39a9deb216848648f9f468edc17ba7a/users/45a468e95e674149bbcae8c56744fa04/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:04:59.038645 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209606b-094d-436a-adb6-1851775596db None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:59.038941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209606b-094d-436a-adb6-1851775596db None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:59.039222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209606b-094d-436a-adb6-1851775596db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:59.067925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2209606b-094d-436a-adb6-1851775596db None None] MFA Rules not processed for user `45a468e95e674149bbcae8c56744fa04`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:59.069146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2209606b-094d-436a-adb6-1851775596db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:59.151075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1127/2284] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:04:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:59.155625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc1a2-0962-4ca7-b726-baf06965889b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:59.218532 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc1a2-0962-4ca7-b726-baf06965889b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:59.223211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16f5fa-60ed-487e-932c-db6d0b9b5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:59.223786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16f5fa-60ed-487e-932c-db6d0b9b5a47 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:59.224062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16f5fa-60ed-487e-932c-db6d0b9b5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:59.224333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16f5fa-60ed-487e-932c-db6d0b9b5a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:59.225045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16f5fa-60ed-487e-932c-db6d0b9b5a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:59.227004 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16f5fa-60ed-487e-932c-db6d0b9b5a47 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:59.254973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1158/2285] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:04:59 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:04:59.260729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209606b-094d-436a-adb6-1851775596db None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:59.275430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209606b-094d-436a-adb6-1851775596db None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:59.362106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d0dff-95cd-46e5-8881-be52476906d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:59.363104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d0dff-95cd-46e5-8881-be52476906d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:59.364050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d0dff-95cd-46e5-8881-be52476906d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:59.364598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d0dff-95cd-46e5-8881-be52476906d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:59.365452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d0dff-95cd-46e5-8881-be52476906d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:59.367610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d0dff-95cd-46e5-8881-be52476906d9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:59.389794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1128/2286] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:04:59 2022] POST /identity/v3/users => generated 297 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:04:59.393715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16f5fa-60ed-487e-932c-db6d0b9b5a47 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:59.404814 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16f5fa-60ed-487e-932c-db6d0b9b5a47 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:59.409813 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e447c-5e1b-43fa-adc0-674227828807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:59.410498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e447c-5e1b-43fa-adc0-674227828807 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:59.410791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e447c-5e1b-43fa-adc0-674227828807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:59.411057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e447c-5e1b-43fa-adc0-674227828807 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:59.411788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e447c-5e1b-43fa-adc0-674227828807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:59.413398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e447c-5e1b-43fa-adc0-674227828807 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:59.424198 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1159/2287] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:04:59.428487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d0dff-95cd-46e5-8881-be52476906d9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:59.438473 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d0dff-95cd-46e5-8881-be52476906d9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:59.443270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e717267-9287-464f-bb02-132207e2a1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:59.444165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e717267-9287-464f-bb02-132207e2a1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:59.444492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e717267-9287-464f-bb02-132207e2a1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:59.444719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e717267-9287-464f-bb02-132207e2a1fd admin admin] PATH_INFO: `/v3/projects/a0720659713d4ab48c5204b07af9aea9/users/6e25433d05464feea3160fa77a6099f1/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:59.461909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e717267-9287-464f-bb02-132207e2a1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0720659713d4ab48c5204b07af9aea9, user_id=6e25433d05464feea3160fa77a6099f1, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:59.465182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e717267-9287-464f-bb02-132207e2a1fd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:59.479137 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1129/2288] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:04:59 2022] PUT /identity/v3/projects/a0720659713d4ab48c5204b07af9aea9/users/6e25433d05464feea3160fa77a6099f1/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:04:59.483263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e447c-5e1b-43fa-adc0-674227828807 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:59.493352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e447c-5e1b-43fa-adc0-674227828807 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:59.549431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1ee2e-b9de-438a-ab7b-6dcb3cb9a355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:59.550158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1ee2e-b9de-438a-ab7b-6dcb3cb9a355 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:59.550594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1ee2e-b9de-438a-ab7b-6dcb3cb9a355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:59.550944 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1ee2e-b9de-438a-ab7b-6dcb3cb9a355 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:59.551628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1ee2e-b9de-438a-ab7b-6dcb3cb9a355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:59.553353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1ee2e-b9de-438a-ab7b-6dcb3cb9a355 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:59.565412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1160/2289] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:04:59.569649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e717267-9287-464f-bb02-132207e2a1fd admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:59.581184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e717267-9287-464f-bb02-132207e2a1fd admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:59.604113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c1850-bceb-4397-b42c-56ca6717e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:59.605052 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c1850-bceb-4397-b42c-56ca6717e0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:59.605334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c1850-bceb-4397-b42c-56ca6717e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:59.605642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c1850-bceb-4397-b42c-56ca6717e0bd admin admin] PATH_INFO: `/v3/projects/a0720659713d4ab48c5204b07af9aea9/users/6e25433d05464feea3160fa77a6099f1/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:59.607763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c1850-bceb-4397-b42c-56ca6717e0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0720659713d4ab48c5204b07af9aea9, user_id=6e25433d05464feea3160fa77a6099f1, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:59.610656 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c1850-bceb-4397-b42c-56ca6717e0bd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:59.633913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ca61e-35cf-4d56-9c6e-d030b2cea2b7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:59.634199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ca61e-35cf-4d56-9c6e-d030b2cea2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:59.634488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ca61e-35cf-4d56-9c6e-d030b2cea2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:59.635591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1130/2290] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:04:59 2022] PUT /identity/v3/projects/a0720659713d4ab48c5204b07af9aea9/users/6e25433d05464feea3160fa77a6099f1/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:04:59.668675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-186ca61e-35cf-4d56-9c6e-d030b2cea2b7 None None] MFA Rules not processed for user `6e25433d05464feea3160fa77a6099f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:04:59.670028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-186ca61e-35cf-4d56-9c6e-d030b2cea2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:59.741748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1161/2291] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:04:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:04:59.754851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c1850-bceb-4397-b42c-56ca6717e0bd admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:04:59.756561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f43c1850-bceb-4397-b42c-56ca6717e0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:04:59.866974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c1850-bceb-4397-b42c-56ca6717e0bd admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:04:59.871322 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124fcc-5254-4128-a268-a3fa5ae3c5db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:04:59.871975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124fcc-5254-4128-a268-a3fa5ae3c5db service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:04:59.872258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124fcc-5254-4128-a268-a3fa5ae3c5db service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:04:59.872534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124fcc-5254-4128-a268-a3fa5ae3c5db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:04:59.882712 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b124fcc-5254-4128-a268-a3fa5ae3c5db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:04:59.884193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b124fcc-5254-4128-a268-a3fa5ae3c5db service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:04:59.894646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1131/2292] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:04:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:00.255100 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ca61e-35cf-4d56-9c6e-d030b2cea2b7 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:00.265159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ca61e-35cf-4d56-9c6e-d030b2cea2b7 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:00.270202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afe1da-3a60-4c34-b767-abdbd12524bb tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e25433d05464feea3160fa77a6099f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0720659713d4ab48c5204b07af9aea9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:00.271022 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afe1da-3a60-4c34-b767-abdbd12524bb tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:00.271391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afe1da-3a60-4c34-b767-abdbd12524bb tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:00.271792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afe1da-3a60-4c34-b767-abdbd12524bb tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:00.272643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afe1da-3a60-4c34-b767-abdbd12524bb tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:00.273032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afe1da-3a60-4c34-b767-abdbd12524bb tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:00.274791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afe1da-3a60-4c34-b767-abdbd12524bb tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:00.288392 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1162/2293] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:00.292424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124fcc-5254-4128-a268-a3fa5ae3c5db service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:00.305303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124fcc-5254-4128-a268-a3fa5ae3c5db service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:00.310223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd343e-8762-4ac7-be96-11fba9949842 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e25433d05464feea3160fa77a6099f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0720659713d4ab48c5204b07af9aea9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:00.310874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd343e-8762-4ac7-be96-11fba9949842 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:00.311154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd343e-8762-4ac7-be96-11fba9949842 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:00.311430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd343e-8762-4ac7-be96-11fba9949842 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:00.312123 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd343e-8762-4ac7-be96-11fba9949842 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:00.314091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd343e-8762-4ac7-be96-11fba9949842 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:00.340246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1132/2294] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:00 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:00.344535 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afe1da-3a60-4c34-b767-abdbd12524bb tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:00.354222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afe1da-3a60-4c34-b767-abdbd12524bb tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:00.408449 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e25433d05464feea3160fa77a6099f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0720659713d4ab48c5204b07af9aea9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:00.409094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:00.409376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:00.409683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:00.410391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:00.410693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:00.412272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:00.423129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1163/2295] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:00.477753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd343e-8762-4ac7-be96-11fba9949842 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:00.490997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd343e-8762-4ac7-be96-11fba9949842 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:00.499735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e25433d05464feea3160fa77a6099f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0720659713d4ab48c5204b07af9aea9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:00.500928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:00.501293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:00.501732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] PATH_INFO: `/v3/projects/cb237d10ba7c409d8015de60b675b645` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:00.503037 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb237d10ba7c409d8015de60b675b645)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:00.505080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:00.562733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb237d10ba7c409d8015de60b675b645', 'request_id': 'req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:00.571192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb237d10ba7c409d8015de60b675b645', 'request_id': 'req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:00.577885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb237d10ba7c409d8015de60b675b645', 'request_id': 'req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:00.590070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] The token cache is being invalidate because project cb237d10ba7c409d8015de60b675b645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:00.590357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:00.591018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bf70f501-5c9e-43c2-bbcc-0069fbb5fff0 tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:00.592707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1133/2296] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:00 2022] DELETE /identity/v3/projects/cb237d10ba7c409d8015de60b675b645 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:00.780738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:00.785293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:00.867785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99587ae2-d670-4be3-be20-e5583efa96dd tempest-VolumeQuotaClassesTest-1569414953 tempest-VolumeQuotaClassesTest-1569414953-project-admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:00.933121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:00.934027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:00.934308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:00.934580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] PATH_INFO: `/v3/users/45a468e95e674149bbcae8c56744fa04` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:00.935767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a468e95e674149bbcae8c56744fa04)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:00.937729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:00.982689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a468e95e674149bbcae8c56744fa04'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:00.983336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a468e95e674149bbcae8c56744fa04'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:00.995058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a468e95e674149bbcae8c56744fa04'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:00.995741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a468e95e674149bbcae8c56744fa04'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.003966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a468e95e674149bbcae8c56744fa04'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.019359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1164/2297] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:00 2022] DELETE /identity/v3/users/45a468e95e674149bbcae8c56744fa04 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:01.024043 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2bab5-5c02-4f0e-a497-d7426c79dc59 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:01.024447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2bab5-5c02-4f0e-a497-d7426c79dc59 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:01.024811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2bab5-5c02-4f0e-a497-d7426c79dc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:01.047846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-08d2bab5-5c02-4f0e-a497-d7426c79dc59 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:01.049810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-08d2bab5-5c02-4f0e-a497-d7426c79dc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:01.114256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1134/2298] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:01.126668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:01.128042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:01.184993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d79cf2-9d99-4d7b-b31a-0b6378a3174b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:01.188906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b126a5-fdc5-47ae-8134-465feb0b171f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:01.189593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b126a5-fdc5-47ae-8134-465feb0b171f service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:01.189877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b126a5-fdc5-47ae-8134-465feb0b171f service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:01.190148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b126a5-fdc5-47ae-8134-465feb0b171f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:01.201146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b126a5-fdc5-47ae-8134-465feb0b171f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:01.202932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b126a5-fdc5-47ae-8134-465feb0b171f service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:01.214874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1165/2299] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:01.540167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2bab5-5c02-4f0e-a497-d7426c79dc59 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:01.541607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-08d2bab5-5c02-4f0e-a497-d7426c79dc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:01.558542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2bab5-5c02-4f0e-a497-d7426c79dc59 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:01.563831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:01.564763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:01.564976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:01.565292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] PATH_INFO: `/v3/projects/e39a9deb216848648f9f468edc17ba7a` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:01.566486 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39a9deb216848648f9f468edc17ba7a)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:01.568388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:01.616142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39a9deb216848648f9f468edc17ba7a', 'request_id': 'req-bbd85f66-d918-4762-a4c1-213ba78aa59b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.623273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39a9deb216848648f9f468edc17ba7a', 'request_id': 'req-bbd85f66-d918-4762-a4c1-213ba78aa59b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.628611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39a9deb216848648f9f468edc17ba7a', 'request_id': 'req-bbd85f66-d918-4762-a4c1-213ba78aa59b'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.639191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] The token cache is being invalidate because project e39a9deb216848648f9f468edc17ba7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:01.639477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.640108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.641704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1135/2300] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:01 2022] DELETE /identity/v3/projects/e39a9deb216848648f9f468edc17ba7a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:01.645644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b126a5-fdc5-47ae-8134-465feb0b171f service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:01.655391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b126a5-fdc5-47ae-8134-465feb0b171f service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:01.724577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:01.725766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:01.726151 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:01.726494 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] PATH_INFO: `/v3/users/6e25433d05464feea3160fa77a6099f1` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:01.727820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e25433d05464feea3160fa77a6099f1)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:01.730640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:01.800052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e25433d05464feea3160fa77a6099f1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.801121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e25433d05464feea3160fa77a6099f1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.816072 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e25433d05464feea3160fa77a6099f1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.817156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e25433d05464feea3160fa77a6099f1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.825967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7497284d-836f-44a0-9d53-7506e2fe99a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e25433d05464feea3160fa77a6099f1'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:01.843772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1166/2301] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:01 2022] DELETE /identity/v3/users/6e25433d05464feea3160fa77a6099f1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:02.234634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:02.236600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:02.267380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85f66-d918-4762-a4c1-213ba78aa59b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:02.350767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:02.351627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.351911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.352188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] PATH_INFO: `/v3/projects/a0720659713d4ab48c5204b07af9aea9` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.353431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0720659713d4ab48c5204b07af9aea9)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:02.355982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:02.435506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0720659713d4ab48c5204b07af9aea9', 'request_id': 'req-98aa6b66-942e-481a-93dc-fcf30c13757a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:02.443380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0720659713d4ab48c5204b07af9aea9', 'request_id': 'req-98aa6b66-942e-481a-93dc-fcf30c13757a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:02.449541 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0720659713d4ab48c5204b07af9aea9', 'request_id': 'req-98aa6b66-942e-481a-93dc-fcf30c13757a'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:02.461865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] The token cache is being invalidate because project a0720659713d4ab48c5204b07af9aea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:02.462153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:02.462817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98aa6b66-942e-481a-93dc-fcf30c13757a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:02.464479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1136/2302] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:02 2022] DELETE /identity/v3/projects/a0720659713d4ab48c5204b07af9aea9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:02.469472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a0093-0a8f-4d62-9d96-1766a0ff58a2 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.469805 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a0093-0a8f-4d62-9d96-1766a0ff58a2 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.470091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a0093-0a8f-4d62-9d96-1766a0ff58a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.488732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f96a0093-0a8f-4d62-9d96-1766a0ff58a2 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:02.489912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f96a0093-0a8f-4d62-9d96-1766a0ff58a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:02.550155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1167/2303] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:02.559533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571026-2b83-424b-8e56-387a35bc3b38 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.559827 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571026-2b83-424b-8e56-387a35bc3b38 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.560112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571026-2b83-424b-8e56-387a35bc3b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.579888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ca571026-2b83-424b-8e56-387a35bc3b38 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:02.581179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ca571026-2b83-424b-8e56-387a35bc3b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:02.596096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1137/2304] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:02.601044 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a0093-0a8f-4d62-9d96-1766a0ff58a2 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:02.611549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a0093-0a8f-4d62-9d96-1766a0ff58a2 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:02.616591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdc704-9e68-4663-80b8-bb77a8a56a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:02.617257 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdc704-9e68-4663-80b8-bb77a8a56a3c admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.617557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdc704-9e68-4663-80b8-bb77a8a56a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.617832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdc704-9e68-4663-80b8-bb77a8a56a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.618692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdc704-9e68-4663-80b8-bb77a8a56a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:02.619007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdc704-9e68-4663-80b8-bb77a8a56a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:02.621158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdc704-9e68-4663-80b8-bb77a8a56a3c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:02.634987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1168/2305] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:02.639540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571026-2b83-424b-8e56-387a35bc3b38 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:02.649572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571026-2b83-424b-8e56-387a35bc3b38 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:02.655195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c4768-9a32-4977-99b4-4661f028167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:02.656080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c4768-9a32-4977-99b4-4661f028167f admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.656799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c4768-9a32-4977-99b4-4661f028167f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.657247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c4768-9a32-4977-99b4-4661f028167f admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.658167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c4768-9a32-4977-99b4-4661f028167f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:02.660257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c4768-9a32-4977-99b4-4661f028167f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:02.687407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1138/2306] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:02 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:02.691717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdc704-9e68-4663-80b8-bb77a8a56a3c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:02.707159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdc704-9e68-4663-80b8-bb77a8a56a3c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:02.767229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57086fa-69a1-4e1c-b361-cd58e30c728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:02.767806 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57086fa-69a1-4e1c-b361-cd58e30c728d admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.768088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57086fa-69a1-4e1c-b361-cd58e30c728d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.768367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57086fa-69a1-4e1c-b361-cd58e30c728d admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.769080 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57086fa-69a1-4e1c-b361-cd58e30c728d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:02.771045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57086fa-69a1-4e1c-b361-cd58e30c728d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:02.790359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1169/2307] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:02 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:02.794844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c4768-9a32-4977-99b4-4661f028167f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:02.804895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c4768-9a32-4977-99b4-4661f028167f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:02.810136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc29a1-d128-4b2c-92c8-c591b3d6db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:02.810791 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc29a1-d128-4b2c-92c8-c591b3d6db87 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.811076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc29a1-d128-4b2c-92c8-c591b3d6db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.811354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc29a1-d128-4b2c-92c8-c591b3d6db87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.812086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc29a1-d128-4b2c-92c8-c591b3d6db87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:02.813725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc29a1-d128-4b2c-92c8-c591b3d6db87 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:02.825217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1139/2308] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:02.829614 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57086fa-69a1-4e1c-b361-cd58e30c728d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:02.840686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57086fa-69a1-4e1c-b361-cd58e30c728d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:02.845739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e508f-e47c-4fa3-857e-22fb028ea650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:02.846486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e508f-e47c-4fa3-857e-22fb028ea650 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.846788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e508f-e47c-4fa3-857e-22fb028ea650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.847068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e508f-e47c-4fa3-857e-22fb028ea650 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.848500 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e508f-e47c-4fa3-857e-22fb028ea650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:02.850283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e508f-e47c-4fa3-857e-22fb028ea650 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:02.863798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1170/2309] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:05:02.867908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc29a1-d128-4b2c-92c8-c591b3d6db87 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:02.887422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc29a1-d128-4b2c-92c8-c591b3d6db87 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:02.892376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a502-bdb3-4bef-9093-dc8307a3a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:02.893275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a502-bdb3-4bef-9093-dc8307a3a05e admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.893577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a502-bdb3-4bef-9093-dc8307a3a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.893860 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a502-bdb3-4bef-9093-dc8307a3a05e admin admin] PATH_INFO: `/v3/projects/b2f392a5604c44fdba84bc93dd195981/users/60938d1464f74db284a565f8abe0d4d2/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.912066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a502-bdb3-4bef-9093-dc8307a3a05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f392a5604c44fdba84bc93dd195981, user_id=60938d1464f74db284a565f8abe0d4d2, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:02.914792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a502-bdb3-4bef-9093-dc8307a3a05e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:02.931318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1140/2310] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:02 2022] PUT /identity/v3/projects/b2f392a5604c44fdba84bc93dd195981/users/60938d1464f74db284a565f8abe0d4d2/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:02.944264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2caf-11a8-4ae0-9061-8e21c8051a7a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:02.944556 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2caf-11a8-4ae0-9061-8e21c8051a7a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:02.944833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2caf-11a8-4ae0-9061-8e21c8051a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:02.975780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e23a2caf-11a8-4ae0-9061-8e21c8051a7a None None] MFA Rules not processed for user `60938d1464f74db284a565f8abe0d4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:02.977053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e23a2caf-11a8-4ae0-9061-8e21c8051a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:03.049211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1171/2311] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:03.050584 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a502-bdb3-4bef-9093-dc8307a3a05e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:03.139217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a502-bdb3-4bef-9093-dc8307a3a05e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:03.148152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e618c6-24de-405f-b65c-8d5456376d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:03.149070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e618c6-24de-405f-b65c-8d5456376d80 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:03.149517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e618c6-24de-405f-b65c-8d5456376d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:03.149941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e618c6-24de-405f-b65c-8d5456376d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:03.150784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e618c6-24de-405f-b65c-8d5456376d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:03.153862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e618c6-24de-405f-b65c-8d5456376d80 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:03.186161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1141/2312] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:03 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:03.190303 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a2caf-11a8-4ae0-9061-8e21c8051a7a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:03.202037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a2caf-11a8-4ae0-9061-8e21c8051a7a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:03.256466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baf950-6145-4a4b-9295-118a5a4556a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:03.257128 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baf950-6145-4a4b-9295-118a5a4556a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:03.257405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baf950-6145-4a4b-9295-118a5a4556a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:03.257711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baf950-6145-4a4b-9295-118a5a4556a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:03.258403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85baf950-6145-4a4b-9295-118a5a4556a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:03.260301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85baf950-6145-4a4b-9295-118a5a4556a2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:03.280239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1172/2313] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:03 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:03.284739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e618c6-24de-405f-b65c-8d5456376d80 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:03.301841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e618c6-24de-405f-b65c-8d5456376d80 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:03.311660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1aa73-5f61-4a14-8d6d-a90c0c9c773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:03.312367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1aa73-5f61-4a14-8d6d-a90c0c9c773a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:03.312730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1aa73-5f61-4a14-8d6d-a90c0c9c773a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:03.313021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1aa73-5f61-4a14-8d6d-a90c0c9c773a admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:03.313926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1aa73-5f61-4a14-8d6d-a90c0c9c773a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:03.315730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1aa73-5f61-4a14-8d6d-a90c0c9c773a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:03.331022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1142/2314] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:05:03.335343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baf950-6145-4a4b-9295-118a5a4556a2 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:03.346944 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baf950-6145-4a4b-9295-118a5a4556a2 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:03.354465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea1267-7091-4c1a-bd2f-8819e26c11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:03.355599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea1267-7091-4c1a-bd2f-8819e26c11f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:03.355957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea1267-7091-4c1a-bd2f-8819e26c11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:03.356307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea1267-7091-4c1a-bd2f-8819e26c11f7 admin admin] PATH_INFO: `/v3/projects/8b2fa2099db045cdb919126cced91425/users/8d88822bea0e47f59f79f109b1bd44a8/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:03.381088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea1267-7091-4c1a-bd2f-8819e26c11f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2fa2099db045cdb919126cced91425, user_id=8d88822bea0e47f59f79f109b1bd44a8, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:03.391436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea1267-7091-4c1a-bd2f-8819e26c11f7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:03.407406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1173/2315] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:03 2022] PUT /identity/v3/projects/8b2fa2099db045cdb919126cced91425/users/8d88822bea0e47f59f79f109b1bd44a8/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:03.411371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1aa73-5f61-4a14-8d6d-a90c0c9c773a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:03.421627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1aa73-5f61-4a14-8d6d-a90c0c9c773a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:03.476631 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323a8ca-03d9-47e2-a8f2-7f007a28fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:03.477294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a8ca-03d9-47e2-a8f2-7f007a28fd38 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:03.477626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a8ca-03d9-47e2-a8f2-7f007a28fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:03.477904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a8ca-03d9-47e2-a8f2-7f007a28fd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:03.478622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323a8ca-03d9-47e2-a8f2-7f007a28fd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:03.480266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323a8ca-03d9-47e2-a8f2-7f007a28fd38 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:03.489447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1143/2316] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:03.493587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea1267-7091-4c1a-bd2f-8819e26c11f7 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:03.504047 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea1267-7091-4c1a-bd2f-8819e26c11f7 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:03.508511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aadeb-3820-4569-8736-2d0afd09a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:03.509370 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aadeb-3820-4569-8736-2d0afd09a20e admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:03.509686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aadeb-3820-4569-8736-2d0afd09a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:03.509959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aadeb-3820-4569-8736-2d0afd09a20e admin admin] PATH_INFO: `/v3/projects/8b2fa2099db045cdb919126cced91425/users/8d88822bea0e47f59f79f109b1bd44a8/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:03.512473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aadeb-3820-4569-8736-2d0afd09a20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2fa2099db045cdb919126cced91425, user_id=8d88822bea0e47f59f79f109b1bd44a8, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:03.515096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aadeb-3820-4569-8736-2d0afd09a20e admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:03.524814 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1174/2317] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:03 2022] PUT /identity/v3/projects/8b2fa2099db045cdb919126cced91425/users/8d88822bea0e47f59f79f109b1bd44a8/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:03.536010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba794fa0-d5e2-411c-962f-09209d4cf7a5 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:03.536307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba794fa0-d5e2-411c-962f-09209d4cf7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:03.536593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba794fa0-d5e2-411c-962f-09209d4cf7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:03.562350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ba794fa0-d5e2-411c-962f-09209d4cf7a5 None None] MFA Rules not processed for user `8d88822bea0e47f59f79f109b1bd44a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:03.563489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ba794fa0-d5e2-411c-962f-09209d4cf7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:03.636601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1144/2318] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:03.649346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aadeb-3820-4569-8736-2d0afd09a20e admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:03.651867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-794aadeb-3820-4569-8736-2d0afd09a20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:03.716396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aadeb-3820-4569-8736-2d0afd09a20e admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:03.720322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586529f-b8b2-48e4-a65c-7e3eddaa8107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:03.721127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586529f-b8b2-48e4-a65c-7e3eddaa8107 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:03.721597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586529f-b8b2-48e4-a65c-7e3eddaa8107 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:03.721883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586529f-b8b2-48e4-a65c-7e3eddaa8107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:03.732377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586529f-b8b2-48e4-a65c-7e3eddaa8107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:03.733891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586529f-b8b2-48e4-a65c-7e3eddaa8107 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:03.744276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1175/2319] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:03.872575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba794fa0-d5e2-411c-962f-09209d4cf7a5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:03.930742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba794fa0-d5e2-411c-962f-09209d4cf7a5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:03.935781 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:03.936642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:03.936925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:03.937198 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] PATH_INFO: `/v3/users/60938d1464f74db284a565f8abe0d4d2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:03.939767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] RBAC: Authorizing `identity:delete_user(user_id=60938d1464f74db284a565f8abe0d4d2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:03.942439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:03.997351 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60938d1464f74db284a565f8abe0d4d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.012541 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60938d1464f74db284a565f8abe0d4d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.024413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60938d1464f74db284a565f8abe0d4d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.025230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60938d1464f74db284a565f8abe0d4d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.036743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60938d1464f74db284a565f8abe0d4d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.045348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1145/2320] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:03 2022] DELETE /identity/v3/users/60938d1464f74db284a565f8abe0d4d2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:04.049944 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ee36-e31e-4901-9f65-dddb266cd4b0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:04.050787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ee36-e31e-4901-9f65-dddb266cd4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:04.051243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ee36-e31e-4901-9f65-dddb266cd4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:04.084946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b770ee36-e31e-4901-9f65-dddb266cd4b0 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:04.086425 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b770ee36-e31e-4901-9f65-dddb266cd4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:04.166437 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1176/2321] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:04.174109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:04.175540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:04.268563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7fb1-e81b-4a2a-aef8-20430fd4e45d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:04.276741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927d13d-7559-4551-8dd4-f9b2f0c78d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:04.277759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927d13d-7559-4551-8dd4-f9b2f0c78d6a service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:04.278446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927d13d-7559-4551-8dd4-f9b2f0c78d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:04.278446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927d13d-7559-4551-8dd4-f9b2f0c78d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:04.300306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927d13d-7559-4551-8dd4-f9b2f0c78d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:04.302254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927d13d-7559-4551-8dd4-f9b2f0c78d6a service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:04.314361 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1146/2322] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:04.647631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ee36-e31e-4901-9f65-dddb266cd4b0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:04.649612 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b770ee36-e31e-4901-9f65-dddb266cd4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:04.664928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ee36-e31e-4901-9f65-dddb266cd4b0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:04.669655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:04.670679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:04.670911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:04.671177 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] PATH_INFO: `/v3/projects/b2f392a5604c44fdba84bc93dd195981` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:04.672385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f392a5604c44fdba84bc93dd195981)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:04.674395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:04.728681 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f392a5604c44fdba84bc93dd195981', 'request_id': 'req-788fc5c0-7082-486d-9e1c-70946f54b578'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.739265 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f392a5604c44fdba84bc93dd195981', 'request_id': 'req-788fc5c0-7082-486d-9e1c-70946f54b578'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.749063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f392a5604c44fdba84bc93dd195981', 'request_id': 'req-788fc5c0-7082-486d-9e1c-70946f54b578'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.762949 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] The token cache is being invalidate because project b2f392a5604c44fdba84bc93dd195981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:04.763271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.764112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.766040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1177/2323] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:04 2022] DELETE /identity/v3/projects/b2f392a5604c44fdba84bc93dd195981 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:04.769747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927d13d-7559-4551-8dd4-f9b2f0c78d6a service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:04.780219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927d13d-7559-4551-8dd4-f9b2f0c78d6a service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:04.839117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:04.840285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:04.840585 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:04.840866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] PATH_INFO: `/v3/users/8d88822bea0e47f59f79f109b1bd44a8` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:04.842394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d88822bea0e47f59f79f109b1bd44a8)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:04.844753 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:04.896968 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d88822bea0e47f59f79f109b1bd44a8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.909780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d88822bea0e47f59f79f109b1bd44a8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.916444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d88822bea0e47f59f79f109b1bd44a8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.917758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d88822bea0e47f59f79f109b1bd44a8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.926026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-99181a09-ab59-46a7-85a9-d0684586908e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d88822bea0e47f59f79f109b1bd44a8'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:04.933084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1147/2324] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:04 2022] DELETE /identity/v3/users/8d88822bea0e47f59f79f109b1bd44a8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:05.253696 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:05.255413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:05.270358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc5c0-7082-486d-9e1c-70946f54b578 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:05.376683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:05.377683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.377952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.378237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] PATH_INFO: `/v3/projects/8b2fa2099db045cdb919126cced91425` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.380503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2fa2099db045cdb919126cced91425)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:05.383597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:05.451754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2fa2099db045cdb919126cced91425', 'request_id': 'req-caec72fd-7289-45dd-89af-3ac18e31687a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:05.460120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2fa2099db045cdb919126cced91425', 'request_id': 'req-caec72fd-7289-45dd-89af-3ac18e31687a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:05.468172 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2fa2099db045cdb919126cced91425', 'request_id': 'req-caec72fd-7289-45dd-89af-3ac18e31687a'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:05.480171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] The token cache is being invalidate because project 8b2fa2099db045cdb919126cced91425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:05.480478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:05.481167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-caec72fd-7289-45dd-89af-3ac18e31687a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:05.483592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1178/2325] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:05 2022] DELETE /identity/v3/projects/8b2fa2099db045cdb919126cced91425 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:05.490358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7731dd-03b2-4b2f-8a02-bbb338d33fdd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.490653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7731dd-03b2-4b2f-8a02-bbb338d33fdd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.490936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7731dd-03b2-4b2f-8a02-bbb338d33fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.515803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7e7731dd-03b2-4b2f-8a02-bbb338d33fdd None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:05.517003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7e7731dd-03b2-4b2f-8a02-bbb338d33fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:05.581031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1148/2326] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:05.588818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52592a82-0a41-4570-9624-160a6307d3ea None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.589633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52592a82-0a41-4570-9624-160a6307d3ea None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.589916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52592a82-0a41-4570-9624-160a6307d3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.607745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-52592a82-0a41-4570-9624-160a6307d3ea None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:05.608927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-52592a82-0a41-4570-9624-160a6307d3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:05.616698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1179/2327] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:05.621302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7731dd-03b2-4b2f-8a02-bbb338d33fdd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:05.630841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7731dd-03b2-4b2f-8a02-bbb338d33fdd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:05.635412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210eaf-e04e-47e7-befb-5acefccb6adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:05.636586 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210eaf-e04e-47e7-befb-5acefccb6adc admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.636870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210eaf-e04e-47e7-befb-5acefccb6adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.637147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210eaf-e04e-47e7-befb-5acefccb6adc admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.637919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e210eaf-e04e-47e7-befb-5acefccb6adc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:05.638228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e210eaf-e04e-47e7-befb-5acefccb6adc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:05.639837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e210eaf-e04e-47e7-befb-5acefccb6adc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:05.651141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1149/2328] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:05.655235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52592a82-0a41-4570-9624-160a6307d3ea None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:05.664450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52592a82-0a41-4570-9624-160a6307d3ea None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:05.669147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a75e-8ae0-4556-aa24-c9898a5fc1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:05.669899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a75e-8ae0-4556-aa24-c9898a5fc1be admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.670186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a75e-8ae0-4556-aa24-c9898a5fc1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.670465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a75e-8ae0-4556-aa24-c9898a5fc1be admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.671152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a75e-8ae0-4556-aa24-c9898a5fc1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:05.673043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a75e-8ae0-4556-aa24-c9898a5fc1be admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:05.703838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1180/2329] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:05 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:05.708392 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210eaf-e04e-47e7-befb-5acefccb6adc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:05.719401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210eaf-e04e-47e7-befb-5acefccb6adc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:05.774279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb9443-03d5-4b53-a19b-73d3d569180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:05.774947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb9443-03d5-4b53-a19b-73d3d569180d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.775228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb9443-03d5-4b53-a19b-73d3d569180d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.775505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb9443-03d5-4b53-a19b-73d3d569180d admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.776718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb9443-03d5-4b53-a19b-73d3d569180d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:05.778719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb9443-03d5-4b53-a19b-73d3d569180d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:05.798672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1150/2330] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:05 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:05.803086 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a75e-8ae0-4556-aa24-c9898a5fc1be admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:05.813130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a75e-8ae0-4556-aa24-c9898a5fc1be admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:05.817726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826d683-c490-46d1-b42a-208e2c26465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:05.818391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826d683-c490-46d1-b42a-208e2c26465e admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.818660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826d683-c490-46d1-b42a-208e2c26465e admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.818934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826d683-c490-46d1-b42a-208e2c26465e admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.819655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826d683-c490-46d1-b42a-208e2c26465e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:05.821253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826d683-c490-46d1-b42a-208e2c26465e admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:05.831499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1181/2331] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:05.835540 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb9443-03d5-4b53-a19b-73d3d569180d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:05.845955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb9443-03d5-4b53-a19b-73d3d569180d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:05.850705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b67164-94af-45c2-a74c-d36970c990c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:05.851359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b67164-94af-45c2-a74c-d36970c990c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.851643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b67164-94af-45c2-a74c-d36970c990c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.851909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b67164-94af-45c2-a74c-d36970c990c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.852632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b67164-94af-45c2-a74c-d36970c990c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:05.854789 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b67164-94af-45c2-a74c-d36970c990c1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:05.864581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1151/2332] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:05.868651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826d683-c490-46d1-b42a-208e2c26465e admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:05.878467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826d683-c490-46d1-b42a-208e2c26465e admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:05.883090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d251-84af-4ac0-9d86-7053dec86491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:05.883952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d251-84af-4ac0-9d86-7053dec86491 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.884237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d251-84af-4ac0-9d86-7053dec86491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.884515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d251-84af-4ac0-9d86-7053dec86491 admin admin] PATH_INFO: `/v3/projects/4777a4177e0f4f39a57368ebbdf14696/users/13fb4e94f2a54827ad5c3d52ff7d624c/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.898255 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d251-84af-4ac0-9d86-7053dec86491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4777a4177e0f4f39a57368ebbdf14696, user_id=13fb4e94f2a54827ad5c3d52ff7d624c, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:05.901409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d251-84af-4ac0-9d86-7053dec86491 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:05.918090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1182/2333] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:05 2022] PUT /identity/v3/projects/4777a4177e0f4f39a57368ebbdf14696/users/13fb4e94f2a54827ad5c3d52ff7d624c/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:05.928167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28374f-0d55-4d69-8e7c-dbdf1ba9777a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:05.928685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28374f-0d55-4d69-8e7c-dbdf1ba9777a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:05.928792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28374f-0d55-4d69-8e7c-dbdf1ba9777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:05.954808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-2d28374f-0d55-4d69-8e7c-dbdf1ba9777a None None] MFA Rules not processed for user `13fb4e94f2a54827ad5c3d52ff7d624c`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:05.955922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2d28374f-0d55-4d69-8e7c-dbdf1ba9777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:06.017498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1152/2334] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:06.021971 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d251-84af-4ac0-9d86-7053dec86491 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:06.086679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d251-84af-4ac0-9d86-7053dec86491 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:06.091339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f5ce4-ccaf-4876-9d9b-9fc8bdc02286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:06.091987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f5ce4-ccaf-4876-9d9b-9fc8bdc02286 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:06.092267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f5ce4-ccaf-4876-9d9b-9fc8bdc02286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:06.092564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f5ce4-ccaf-4876-9d9b-9fc8bdc02286 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:06.093236 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f5ce4-ccaf-4876-9d9b-9fc8bdc02286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:06.095167 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f5ce4-ccaf-4876-9d9b-9fc8bdc02286 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:06.119538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1183/2335] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:06 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:06.124257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28374f-0d55-4d69-8e7c-dbdf1ba9777a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:06.134977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28374f-0d55-4d69-8e7c-dbdf1ba9777a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:06.189235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f13459-8076-4757-a115-7d3d09e18ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:06.189932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f13459-8076-4757-a115-7d3d09e18ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:06.190214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f13459-8076-4757-a115-7d3d09e18ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:06.190487 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f13459-8076-4757-a115-7d3d09e18ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:06.191363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f13459-8076-4757-a115-7d3d09e18ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:06.193277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f13459-8076-4757-a115-7d3d09e18ed8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:06.214193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1153/2336] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:06 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:06.217883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f5ce4-ccaf-4876-9d9b-9fc8bdc02286 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:06.228065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f5ce4-ccaf-4876-9d9b-9fc8bdc02286 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:06.232707 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fc32c-5dc7-47ef-bdc4-fb4a5a5ff7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:06.233367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fc32c-5dc7-47ef-bdc4-fb4a5a5ff7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:06.233687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fc32c-5dc7-47ef-bdc4-fb4a5a5ff7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:06.233964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fc32c-5dc7-47ef-bdc4-fb4a5a5ff7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:06.234868 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fc32c-5dc7-47ef-bdc4-fb4a5a5ff7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:06.236308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fc32c-5dc7-47ef-bdc4-fb4a5a5ff7d0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:06.246787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1184/2337] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:06.250892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f13459-8076-4757-a115-7d3d09e18ed8 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:06.261204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f13459-8076-4757-a115-7d3d09e18ed8 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:06.265973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d6d18-ff7e-4eae-89c3-68d9467c53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:06.266855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d6d18-ff7e-4eae-89c3-68d9467c53a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:06.267141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d6d18-ff7e-4eae-89c3-68d9467c53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:06.267420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d6d18-ff7e-4eae-89c3-68d9467c53a6 admin admin] PATH_INFO: `/v3/projects/9776028bdd6e4890924913ea621fe2ef/users/3b223c8a526b4fad997be60928ca10b0/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:06.282057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d6d18-ff7e-4eae-89c3-68d9467c53a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9776028bdd6e4890924913ea621fe2ef, user_id=3b223c8a526b4fad997be60928ca10b0, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:06.284707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d6d18-ff7e-4eae-89c3-68d9467c53a6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:06.297332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1154/2338] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:06 2022] PUT /identity/v3/projects/9776028bdd6e4890924913ea621fe2ef/users/3b223c8a526b4fad997be60928ca10b0/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:06.306226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fc32c-5dc7-47ef-bdc4-fb4a5a5ff7d0 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:06.316875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fc32c-5dc7-47ef-bdc4-fb4a5a5ff7d0 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:06.373008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579fa7-9d2b-4162-859a-b34ebb5db7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:06.373694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579fa7-9d2b-4162-859a-b34ebb5db7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:06.374102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579fa7-9d2b-4162-859a-b34ebb5db7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:06.374445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579fa7-9d2b-4162-859a-b34ebb5db7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:06.375156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579fa7-9d2b-4162-859a-b34ebb5db7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:06.376742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579fa7-9d2b-4162-859a-b34ebb5db7c2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:06.386077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1185/2339] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:06.390218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d6d18-ff7e-4eae-89c3-68d9467c53a6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:06.400386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d6d18-ff7e-4eae-89c3-68d9467c53a6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:06.405607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50aa1c-7aee-4e0b-ac42-5d83645b5b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:06.406672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50aa1c-7aee-4e0b-ac42-5d83645b5b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:06.406957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50aa1c-7aee-4e0b-ac42-5d83645b5b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:06.407233 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50aa1c-7aee-4e0b-ac42-5d83645b5b43 admin admin] PATH_INFO: `/v3/projects/9776028bdd6e4890924913ea621fe2ef/users/3b223c8a526b4fad997be60928ca10b0/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:06.409187 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50aa1c-7aee-4e0b-ac42-5d83645b5b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9776028bdd6e4890924913ea621fe2ef, user_id=3b223c8a526b4fad997be60928ca10b0, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:06.411861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50aa1c-7aee-4e0b-ac42-5d83645b5b43 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:06.422643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1155/2340] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:06 2022] PUT /identity/v3/projects/9776028bdd6e4890924913ea621fe2ef/users/3b223c8a526b4fad997be60928ca10b0/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:06.433776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858380c1-4a91-44e7-bf15-19839ef5f475 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:06.434064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858380c1-4a91-44e7-bf15-19839ef5f475 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:06.434337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858380c1-4a91-44e7-bf15-19839ef5f475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:06.459690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-858380c1-4a91-44e7-bf15-19839ef5f475 None None] MFA Rules not processed for user `3b223c8a526b4fad997be60928ca10b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:06.460889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-858380c1-4a91-44e7-bf15-19839ef5f475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:06.528729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1186/2341] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:06.539583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50aa1c-7aee-4e0b-ac42-5d83645b5b43 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:06.541453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-af50aa1c-7aee-4e0b-ac42-5d83645b5b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:06.601153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50aa1c-7aee-4e0b-ac42-5d83645b5b43 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:06.605058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d764e3-88be-41f9-ba09-cbd878875c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:06.605741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d764e3-88be-41f9-ba09-cbd878875c7a service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:06.606027 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d764e3-88be-41f9-ba09-cbd878875c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:06.606324 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d764e3-88be-41f9-ba09-cbd878875c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:06.661943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d764e3-88be-41f9-ba09-cbd878875c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:06.663458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d764e3-88be-41f9-ba09-cbd878875c7a service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:06.682962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1156/2342] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:10.839540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858380c1-4a91-44e7-bf15-19839ef5f475 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:10.841013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-858380c1-4a91-44e7-bf15-19839ef5f475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:10.852528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858380c1-4a91-44e7-bf15-19839ef5f475 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:10.856585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956678c-aeb2-46a6-88ee-822b0726437c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:10.857357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956678c-aeb2-46a6-88ee-822b0726437c service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:10.857691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956678c-aeb2-46a6-88ee-822b0726437c service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:10.857977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956678c-aeb2-46a6-88ee-822b0726437c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:10.867368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956678c-aeb2-46a6-88ee-822b0726437c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:10.868807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956678c-aeb2-46a6-88ee-822b0726437c service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:10.878768 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1187/2343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:10.982251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d764e3-88be-41f9-ba09-cbd878875c7a service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:10.984234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a2d764e3-88be-41f9-ba09-cbd878875c7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:11.068074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d764e3-88be-41f9-ba09-cbd878875c7a service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:11.074599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:11.075402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:11.075718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:11.076001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:11.077966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:11.091543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:11.093307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:11.104966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1157/2344] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:12.843287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14f338-5b01-460d-9402-114650a2bb86 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:12.843802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14f338-5b01-460d-9402-114650a2bb86 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:12.843919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14f338-5b01-460d-9402-114650a2bb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:12.863227 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-eb14f338-5b01-460d-9402-114650a2bb86 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:12.864575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-eb14f338-5b01-460d-9402-114650a2bb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:12.921126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1188/2345] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 12 19:05:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:12.934041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:12.935433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:13.001995 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea07a1-7c24-44e7-9328-40d609f02b4f service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:13.006921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a0e91-c11d-4a20-989a-1b27c05b9890 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:13.007554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a0e91-c11d-4a20-989a-1b27c05b9890 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:13.007837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a0e91-c11d-4a20-989a-1b27c05b9890 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:13.008109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a0e91-c11d-4a20-989a-1b27c05b9890 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:13.015809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a0e91-c11d-4a20-989a-1b27c05b9890 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:13.017372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a0e91-c11d-4a20-989a-1b27c05b9890 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:13.025355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1158/2346] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:05:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:05:15.781328 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14f338-5b01-460d-9402-114650a2bb86 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:15.840990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14f338-5b01-460d-9402-114650a2bb86 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:15.845407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:15.846291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:15.846568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:15.846838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] PATH_INFO: `/v3/users/13fb4e94f2a54827ad5c3d52ff7d624c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:15.848008 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fb4e94f2a54827ad5c3d52ff7d624c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:15.849963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:15.895117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fb4e94f2a54827ad5c3d52ff7d624c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:15.895763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fb4e94f2a54827ad5c3d52ff7d624c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:15.908222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fb4e94f2a54827ad5c3d52ff7d624c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:15.908861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fb4e94f2a54827ad5c3d52ff7d624c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:15.916900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fb4e94f2a54827ad5c3d52ff7d624c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:15.928829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1189/2347] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:15 2022] DELETE /identity/v3/users/13fb4e94f2a54827ad5c3d52ff7d624c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:15.933373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199726-4906-4569-a101-2056651a361f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:15.934100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199726-4906-4569-a101-2056651a361f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:15.936989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199726-4906-4569-a101-2056651a361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:15.954439 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-33199726-4906-4569-a101-2056651a361f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:15.955617 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-33199726-4906-4569-a101-2056651a361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:16.016645 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1159/2348] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:16.026716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:16.028130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:16.084408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaed68-5267-4a97-aaf2-f1c3848555d5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:16.088695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ea90f-dc95-43db-bf6f-6d4126d75e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:16.089372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ea90f-dc95-43db-bf6f-6d4126d75e50 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:16.089716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ea90f-dc95-43db-bf6f-6d4126d75e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:16.089993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ea90f-dc95-43db-bf6f-6d4126d75e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:16.099226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ea90f-dc95-43db-bf6f-6d4126d75e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:16.100656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ea90f-dc95-43db-bf6f-6d4126d75e50 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:16.114186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1190/2349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:16.375787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33199726-4906-4569-a101-2056651a361f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:16.377294 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-33199726-4906-4569-a101-2056651a361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:16.390760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33199726-4906-4569-a101-2056651a361f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:16.395300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:16.396187 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:16.396618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:16.396917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] PATH_INFO: `/v3/projects/4777a4177e0f4f39a57368ebbdf14696` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:16.398106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4777a4177e0f4f39a57368ebbdf14696)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:16.400002 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:16.446293 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4777a4177e0f4f39a57368ebbdf14696', 'request_id': 'req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.453704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4777a4177e0f4f39a57368ebbdf14696', 'request_id': 'req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.458958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4777a4177e0f4f39a57368ebbdf14696', 'request_id': 'req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.469406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] The token cache is being invalidate because project 4777a4177e0f4f39a57368ebbdf14696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:16.469724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.470341 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.471848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1160/2350] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:16 2022] DELETE /identity/v3/projects/4777a4177e0f4f39a57368ebbdf14696 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:16.475983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ea90f-dc95-43db-bf6f-6d4126d75e50 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:16.486358 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ea90f-dc95-43db-bf6f-6d4126d75e50 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:16.540212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:16.541615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:16.541895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:16.542168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] PATH_INFO: `/v3/users/3b223c8a526b4fad997be60928ca10b0` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:16.543330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b223c8a526b4fad997be60928ca10b0)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:16.545239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:16.589435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b223c8a526b4fad997be60928ca10b0'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.590094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b223c8a526b4fad997be60928ca10b0'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.601271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b223c8a526b4fad997be60928ca10b0'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.601909 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b223c8a526b4fad997be60928ca10b0'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.609054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b6823239-4fcb-4a66-b876-5023805f1874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b223c8a526b4fad997be60928ca10b0'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:16.620704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1191/2351] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:16 2022] DELETE /identity/v3/users/3b223c8a526b4fad997be60928ca10b0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:16.899610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:16.901194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:16.919006 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbf4f1-e3ef-4cf9-a53c-b6e109adcfbf admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:16.984881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:16.985768 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:16.986046 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:16.986320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] PATH_INFO: `/v3/projects/9776028bdd6e4890924913ea621fe2ef` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:16.987610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9776028bdd6e4890924913ea621fe2ef)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:16.989757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:17.039139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9776028bdd6e4890924913ea621fe2ef', 'request_id': 'req-eed9be77-a02b-4101-bfec-38fe09c3f07f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.048216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9776028bdd6e4890924913ea621fe2ef', 'request_id': 'req-eed9be77-a02b-4101-bfec-38fe09c3f07f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.055120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9776028bdd6e4890924913ea621fe2ef', 'request_id': 'req-eed9be77-a02b-4101-bfec-38fe09c3f07f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.065727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] The token cache is being invalidate because project 9776028bdd6e4890924913ea621fe2ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:17.066021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.066704 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-eed9be77-a02b-4101-bfec-38fe09c3f07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.068456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1161/2352] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:16 2022] DELETE /identity/v3/projects/9776028bdd6e4890924913ea621fe2ef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:17.074450 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13939867-ddf8-4077-b2de-3172a8d38714 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.074934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13939867-ddf8-4077-b2de-3172a8d38714 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.075028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13939867-ddf8-4077-b2de-3172a8d38714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.094329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-13939867-ddf8-4077-b2de-3172a8d38714 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:17.095576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-13939867-ddf8-4077-b2de-3172a8d38714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:17.153254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1192/2353] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:17.162021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08dd17-774b-4d0f-9f91-e0870395aaf1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.162348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08dd17-774b-4d0f-9f91-e0870395aaf1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.162632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08dd17-774b-4d0f-9f91-e0870395aaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.181075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1b08dd17-774b-4d0f-9f91-e0870395aaf1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:17.182878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1b08dd17-774b-4d0f-9f91-e0870395aaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:17.191099 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1162/2354] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:17.195329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13939867-ddf8-4077-b2de-3172a8d38714 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:17.205365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13939867-ddf8-4077-b2de-3172a8d38714 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:17.210019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3999d6-da78-4a57-97d8-87013e850a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:17.210672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3999d6-da78-4a57-97d8-87013e850a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.210956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3999d6-da78-4a57-97d8-87013e850a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.211269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3999d6-da78-4a57-97d8-87013e850a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.211966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3999d6-da78-4a57-97d8-87013e850a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:17.212272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3999d6-da78-4a57-97d8-87013e850a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:17.213929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3999d6-da78-4a57-97d8-87013e850a7e admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:17.225905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1193/2355] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:17.231152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08dd17-774b-4d0f-9f91-e0870395aaf1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:17.240061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08dd17-774b-4d0f-9f91-e0870395aaf1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:17.245227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979999-74c4-4220-80ff-f25e96ee97dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:17.245906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979999-74c4-4220-80ff-f25e96ee97dc admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.246193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979999-74c4-4220-80ff-f25e96ee97dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.246470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979999-74c4-4220-80ff-f25e96ee97dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.247161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d979999-74c4-4220-80ff-f25e96ee97dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:17.249044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d979999-74c4-4220-80ff-f25e96ee97dc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:17.272602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1163/2356] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:17 2022] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:17.276850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3999d6-da78-4a57-97d8-87013e850a7e admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:17.287014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3999d6-da78-4a57-97d8-87013e850a7e admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:17.342081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43a21d-75e7-4437-b9ef-60fa39d97fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:17.342791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a21d-75e7-4437-b9ef-60fa39d97fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.343074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a21d-75e7-4437-b9ef-60fa39d97fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.343349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a21d-75e7-4437-b9ef-60fa39d97fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.344042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43a21d-75e7-4437-b9ef-60fa39d97fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:17.345978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43a21d-75e7-4437-b9ef-60fa39d97fd5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:17.367794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1194/2357] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:17 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:17.372602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979999-74c4-4220-80ff-f25e96ee97dc admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:17.383791 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979999-74c4-4220-80ff-f25e96ee97dc admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:17.392103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ebd18-a83e-4bde-98b4-9c5a3220917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:17.392777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ebd18-a83e-4bde-98b4-9c5a3220917c admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.393062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ebd18-a83e-4bde-98b4-9c5a3220917c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.393355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ebd18-a83e-4bde-98b4-9c5a3220917c admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.394114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ebd18-a83e-4bde-98b4-9c5a3220917c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:17.395720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ebd18-a83e-4bde-98b4-9c5a3220917c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:17.406936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1164/2358] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:17.411039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43a21d-75e7-4437-b9ef-60fa39d97fd5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:17.421346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43a21d-75e7-4437-b9ef-60fa39d97fd5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:17.426118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ab1f9-c23c-4f6f-9d7a-ef62cdfd2eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:17.426776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab1f9-c23c-4f6f-9d7a-ef62cdfd2eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.427065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab1f9-c23c-4f6f-9d7a-ef62cdfd2eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.427338 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab1f9-c23c-4f6f-9d7a-ef62cdfd2eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.428057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab1f9-c23c-4f6f-9d7a-ef62cdfd2eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:17.429682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab1f9-c23c-4f6f-9d7a-ef62cdfd2eb3 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:17.440460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1195/2359] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:17.444696 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ebd18-a83e-4bde-98b4-9c5a3220917c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:17.454560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ebd18-a83e-4bde-98b4-9c5a3220917c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:17.459206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8079c-bdfb-4816-b1b3-579aba2d498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:17.460073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8079c-bdfb-4816-b1b3-579aba2d498c admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.460355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8079c-bdfb-4816-b1b3-579aba2d498c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.460628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8079c-bdfb-4816-b1b3-579aba2d498c admin admin] PATH_INFO: `/v3/projects/071872dfb0cc4e799a2cd0d7ab3e8f3a/users/2d3f66e25b944fc3bfaadb797d7b665e/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.475607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8079c-bdfb-4816-b1b3-579aba2d498c admin admin] RBAC: Authorizing `identity:create_grant(project_id=071872dfb0cc4e799a2cd0d7ab3e8f3a, user_id=2d3f66e25b944fc3bfaadb797d7b665e, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:17.478844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8079c-bdfb-4816-b1b3-579aba2d498c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:17.495279 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1165/2360] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:17 2022] PUT /identity/v3/projects/071872dfb0cc4e799a2cd0d7ab3e8f3a/users/2d3f66e25b944fc3bfaadb797d7b665e/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:17.506564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850ae6-5d61-48e4-8004-ece357542fe8 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.506853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850ae6-5d61-48e4-8004-ece357542fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.507131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850ae6-5d61-48e4-8004-ece357542fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.533550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-30850ae6-5d61-48e4-8004-ece357542fe8 None None] MFA Rules not processed for user `2d3f66e25b944fc3bfaadb797d7b665e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:17.534775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-30850ae6-5d61-48e4-8004-ece357542fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:17.599658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1196/2361] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:17.611247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8079c-bdfb-4816-b1b3-579aba2d498c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:17.613060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f7a8079c-bdfb-4816-b1b3-579aba2d498c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:17.668661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8079c-bdfb-4816-b1b3-579aba2d498c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:17.672204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bf6c1-172a-455d-8edd-c314a7ce271f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:17.672839 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bf6c1-172a-455d-8edd-c314a7ce271f service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.673119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bf6c1-172a-455d-8edd-c314a7ce271f service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.673390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bf6c1-172a-455d-8edd-c314a7ce271f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.682336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bf6c1-172a-455d-8edd-c314a7ce271f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:17.683782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bf6c1-172a-455d-8edd-c314a7ce271f service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:17.692764 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1166/2362] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:17.718170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850ae6-5d61-48e4-8004-ece357542fe8 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:17.796105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850ae6-5d61-48e4-8004-ece357542fe8 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:17.800644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:17.801758 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.802042 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.802429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] PATH_INFO: `/v3/users/2d3f66e25b944fc3bfaadb797d7b665e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.803629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3f66e25b944fc3bfaadb797d7b665e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:17.805603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:17.858061 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3f66e25b944fc3bfaadb797d7b665e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.858719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3f66e25b944fc3bfaadb797d7b665e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.871142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3f66e25b944fc3bfaadb797d7b665e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.871802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3f66e25b944fc3bfaadb797d7b665e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.879549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3f66e25b944fc3bfaadb797d7b665e'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:17.892361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1197/2363] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:17 2022] DELETE /identity/v3/users/2d3f66e25b944fc3bfaadb797d7b665e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:17.897076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29f764-c2a7-4945-a17a-ecd7d999619c None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:17.897546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29f764-c2a7-4945-a17a-ecd7d999619c None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:17.897912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29f764-c2a7-4945-a17a-ecd7d999619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:17.916778 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7a29f764-c2a7-4945-a17a-ecd7d999619c None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:17.918097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7a29f764-c2a7-4945-a17a-ecd7d999619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:17.985997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1167/2364] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:17.999399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:18.000976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:18.063508 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b63d8-c2de-4ac5-9b5a-20276ab3a4a3 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:18.067409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5bc72-9c44-4c5c-a3c2-982e6d3e7cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:18.068097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5bc72-9c44-4c5c-a3c2-982e6d3e7cdb service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:18.068385 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5bc72-9c44-4c5c-a3c2-982e6d3e7cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:18.068663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5bc72-9c44-4c5c-a3c2-982e6d3e7cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:18.078411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5bc72-9c44-4c5c-a3c2-982e6d3e7cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:18.079888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5bc72-9c44-4c5c-a3c2-982e6d3e7cdb service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:18.090529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1198/2365] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:18.313702 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29f764-c2a7-4945-a17a-ecd7d999619c None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:18.316587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7a29f764-c2a7-4945-a17a-ecd7d999619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:18.414897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29f764-c2a7-4945-a17a-ecd7d999619c None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:18.422699 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fc660-3234-4fcf-a0c6-eea225fd9fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:18.423822 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fc660-3234-4fcf-a0c6-eea225fd9fa4 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:18.424368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fc660-3234-4fcf-a0c6-eea225fd9fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:18.424915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fc660-3234-4fcf-a0c6-eea225fd9fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:18.427119 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e20fc660-3234-4fcf-a0c6-eea225fd9fa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:18.448267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fc660-3234-4fcf-a0c6-eea225fd9fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:18.450062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fc660-3234-4fcf-a0c6-eea225fd9fa4 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:18.472221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1168/2366] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:18.591615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5bc72-9c44-4c5c-a3c2-982e6d3e7cdb service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:18.593837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-faf5bc72-9c44-4c5c-a3c2-982e6d3e7cdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:18.611322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5bc72-9c44-4c5c-a3c2-982e6d3e7cdb service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:18.616310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:18.617173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:18.617457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:18.618099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] PATH_INFO: `/v3/projects/071872dfb0cc4e799a2cd0d7ab3e8f3a` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:18.619981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=071872dfb0cc4e799a2cd0d7ab3e8f3a)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:18.621958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:18.671704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071872dfb0cc4e799a2cd0d7ab3e8f3a', 'request_id': 'req-872e8905-e6b9-4af4-873f-1a44d4b238ac'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:18.679246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071872dfb0cc4e799a2cd0d7ab3e8f3a', 'request_id': 'req-872e8905-e6b9-4af4-873f-1a44d4b238ac'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:18.685546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071872dfb0cc4e799a2cd0d7ab3e8f3a', 'request_id': 'req-872e8905-e6b9-4af4-873f-1a44d4b238ac'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:18.695571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] The token cache is being invalidate because project 071872dfb0cc4e799a2cd0d7ab3e8f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:18.695899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:18.696530 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-872e8905-e6b9-4af4-873f-1a44d4b238ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:18.698114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1199/2367] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:18 2022] DELETE /identity/v3/projects/071872dfb0cc4e799a2cd0d7ab3e8f3a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:18.703024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54593636-f635-4b18-bc05-afac93ca0fe1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:18.703417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54593636-f635-4b18-bc05-afac93ca0fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:18.703796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54593636-f635-4b18-bc05-afac93ca0fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:18.723909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-54593636-f635-4b18-bc05-afac93ca0fe1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:18.725129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-54593636-f635-4b18-bc05-afac93ca0fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:18.793287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1169/2368] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:18.802455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418d2b-c073-4b5e-9be1-f82fea4c13ec None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:18.802831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418d2b-c073-4b5e-9be1-f82fea4c13ec None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:18.803176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418d2b-c073-4b5e-9be1-f82fea4c13ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:18.823573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-aa418d2b-c073-4b5e-9be1-f82fea4c13ec None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:18.826079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-aa418d2b-c073-4b5e-9be1-f82fea4c13ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:18.834359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1200/2369] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:18.839364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54593636-f635-4b18-bc05-afac93ca0fe1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:18.849179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54593636-f635-4b18-bc05-afac93ca0fe1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:18.855366 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd019881-42a3-4bdf-beb1-24caad9323d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:18.856108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd019881-42a3-4bdf-beb1-24caad9323d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:18.856395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd019881-42a3-4bdf-beb1-24caad9323d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:18.856678 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd019881-42a3-4bdf-beb1-24caad9323d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:18.857516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd019881-42a3-4bdf-beb1-24caad9323d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:18.857856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd019881-42a3-4bdf-beb1-24caad9323d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:18.859558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd019881-42a3-4bdf-beb1-24caad9323d3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:18.872566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1170/2370] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:18.877127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa418d2b-c073-4b5e-9be1-f82fea4c13ec None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:18.886756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa418d2b-c073-4b5e-9be1-f82fea4c13ec None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:18.891832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c3301-ecc2-476f-92f0-17427d0e8c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:18.892497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c3301-ecc2-476f-92f0-17427d0e8c21 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:18.892780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c3301-ecc2-476f-92f0-17427d0e8c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:18.893056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c3301-ecc2-476f-92f0-17427d0e8c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:18.893922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c3301-ecc2-476f-92f0-17427d0e8c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:18.895850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c3301-ecc2-476f-92f0-17427d0e8c21 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:18.923582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1201/2371] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:18 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:18.927986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd019881-42a3-4bdf-beb1-24caad9323d3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:18.938622 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd019881-42a3-4bdf-beb1-24caad9323d3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:18.998050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882664c-b876-40ea-b5e8-19830ac0f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:18.998732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882664c-b876-40ea-b5e8-19830ac0f853 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:18.998983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882664c-b876-40ea-b5e8-19830ac0f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:18.999278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882664c-b876-40ea-b5e8-19830ac0f853 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:18.999963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882664c-b876-40ea-b5e8-19830ac0f853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:19.001922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882664c-b876-40ea-b5e8-19830ac0f853 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:19.024339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1171/2372] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:18 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:19.025740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c3301-ecc2-476f-92f0-17427d0e8c21 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:19.036422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c3301-ecc2-476f-92f0-17427d0e8c21 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:19.042572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f674c-7b3a-4cfc-a3e1-3dbbc796d9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:19.043405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f674c-7b3a-4cfc-a3e1-3dbbc796d9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:19.043585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f674c-7b3a-4cfc-a3e1-3dbbc796d9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:19.043982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f674c-7b3a-4cfc-a3e1-3dbbc796d9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:19.044782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f674c-7b3a-4cfc-a3e1-3dbbc796d9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:19.046511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f674c-7b3a-4cfc-a3e1-3dbbc796d9b4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:19.060417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1202/2373] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:19.063503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882664c-b876-40ea-b5e8-19830ac0f853 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:19.076967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882664c-b876-40ea-b5e8-19830ac0f853 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:19.081890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de6766-06dd-4aa9-bee3-10a3f545b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:19.082557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de6766-06dd-4aa9-bee3-10a3f545b946 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:19.082844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de6766-06dd-4aa9-bee3-10a3f545b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:19.083125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de6766-06dd-4aa9-bee3-10a3f545b946 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:19.084412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de6766-06dd-4aa9-bee3-10a3f545b946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:19.085820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de6766-06dd-4aa9-bee3-10a3f545b946 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:19.096965 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1172/2374] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:19.100864 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f674c-7b3a-4cfc-a3e1-3dbbc796d9b4 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:19.112492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f674c-7b3a-4cfc-a3e1-3dbbc796d9b4 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:19.117969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47b4c7-9550-45d9-8ed2-5300837c6333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:19.119322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47b4c7-9550-45d9-8ed2-5300837c6333 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:19.119601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47b4c7-9550-45d9-8ed2-5300837c6333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:19.120279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47b4c7-9550-45d9-8ed2-5300837c6333 admin admin] PATH_INFO: `/v3/projects/69299e9979554ba2b07a5e29d1b792b8/users/4afe3e5522534562ad835af83b830ab9/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:19.138536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47b4c7-9550-45d9-8ed2-5300837c6333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69299e9979554ba2b07a5e29d1b792b8, user_id=4afe3e5522534562ad835af83b830ab9, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:19.141677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47b4c7-9550-45d9-8ed2-5300837c6333 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:19.160402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1203/2375] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:19 2022] PUT /identity/v3/projects/69299e9979554ba2b07a5e29d1b792b8/users/4afe3e5522534562ad835af83b830ab9/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:19.165224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631b95-bd05-4a89-a92d-2ee1699e28ed None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:19.165557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631b95-bd05-4a89-a92d-2ee1699e28ed None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:19.166405 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631b95-bd05-4a89-a92d-2ee1699e28ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:19.190498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-24631b95-bd05-4a89-a92d-2ee1699e28ed None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:19.192188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-24631b95-bd05-4a89-a92d-2ee1699e28ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:19.255402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1173/2376] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:19.269771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47b4c7-9550-45d9-8ed2-5300837c6333 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:19.275485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1f47b4c7-9550-45d9-8ed2-5300837c6333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:19.344156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47b4c7-9550-45d9-8ed2-5300837c6333 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:19.349289 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ddbcc-2c51-47d8-95bf-b762d12bac65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:19.349979 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ddbcc-2c51-47d8-95bf-b762d12bac65 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:19.350261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ddbcc-2c51-47d8-95bf-b762d12bac65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:19.350531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ddbcc-2c51-47d8-95bf-b762d12bac65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:19.361574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ddbcc-2c51-47d8-95bf-b762d12bac65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:19.363632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ddbcc-2c51-47d8-95bf-b762d12bac65 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:19.375908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1204/2377] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:20.295342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ead090-f003-45b7-9bf6-31c38f0dcfd2 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:20.295822 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ead090-f003-45b7-9bf6-31c38f0dcfd2 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:20.295936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ead090-f003-45b7-9bf6-31c38f0dcfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:20.320885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-83ead090-f003-45b7-9bf6-31c38f0dcfd2 None None] MFA Rules not processed for user `4afe3e5522534562ad835af83b830ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:20.322569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-83ead090-f003-45b7-9bf6-31c38f0dcfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:20.387520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1174/2378] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:20.398134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ddbcc-2c51-47d8-95bf-b762d12bac65 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:20.399548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5b9ddbcc-2c51-47d8-95bf-b762d12bac65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:20.454846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ddbcc-2c51-47d8-95bf-b762d12bac65 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:20.458547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b95f-c9bf-4b19-b664-f01540d39e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:20.459195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b95f-c9bf-4b19-b664-f01540d39e46 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:20.459478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b95f-c9bf-4b19-b664-f01540d39e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:20.459757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b95f-c9bf-4b19-b664-f01540d39e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:20.468408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b95f-c9bf-4b19-b664-f01540d39e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:20.469882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b95f-c9bf-4b19-b664-f01540d39e46 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:20.479373 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1205/2379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:21.818451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ed52-e4c4-4abc-9ec1-314ea21627eb None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:21.818951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ed52-e4c4-4abc-9ec1-314ea21627eb None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:21.819045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ed52-e4c4-4abc-9ec1-314ea21627eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:21.836832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-ace2ed52-e4c4-4abc-9ec1-314ea21627eb None None] MFA Rules not processed for user `4afe3e5522534562ad835af83b830ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:21.838584 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ace2ed52-e4c4-4abc-9ec1-314ea21627eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:21.845436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1175/2380] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:22.069751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b95f-c9bf-4b19-b664-f01540d39e46 service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:22.079586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b95f-c9bf-4b19-b664-f01540d39e46 service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:22.083168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:22.083790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:22.084072 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:22.084344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:22.086073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:22.095159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:22.096579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:22.104275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1206/2381] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:23.855576 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ed52-e4c4-4abc-9ec1-314ea21627eb None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:23.864997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ed52-e4c4-4abc-9ec1-314ea21627eb None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:23.868989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf4ce-c424-443e-aa39-6920dcdc6f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:23.869657 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf4ce-c424-443e-aa39-6920dcdc6f61 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:23.869936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf4ce-c424-443e-aa39-6920dcdc6f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:23.870207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf4ce-c424-443e-aa39-6920dcdc6f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:23.872057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f8ddf4ce-c424-443e-aa39-6920dcdc6f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:23.883448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf4ce-c424-443e-aa39-6920dcdc6f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:23.885444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf4ce-c424-443e-aa39-6920dcdc6f61 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:23.894644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1176/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:28.140400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:28.141957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:28.157222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1086a-52e4-4793-a252-ee45df98f45f service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:28.175792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:28.176786 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:28.177214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:28.177625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] PATH_INFO: `/v3/users/e1ebd0110fff4620b11e881c90470cda` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:28.178935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ebd0110fff4620b11e881c90470cda)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:28.181052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:28.238485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ebd0110fff4620b11e881c90470cda'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.239185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ebd0110fff4620b11e881c90470cda'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.252168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ebd0110fff4620b11e881c90470cda'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.252893 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ebd0110fff4620b11e881c90470cda'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.261303 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5193e264-efd5-45d8-829c-c5fafef46df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ebd0110fff4620b11e881c90470cda'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.274101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1207/2383] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:28 2022] DELETE /identity/v3/users/e1ebd0110fff4620b11e881c90470cda => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:28.464478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf4ce-c424-443e-aa39-6920dcdc6f61 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:28.481424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf4ce-c424-443e-aa39-6920dcdc6f61 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:28.546307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:28.547147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:28.547400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:28.547651 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] PATH_INFO: `/v3/projects/1579004868f04df3baa3ad959277ba00` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:28.548886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1579004868f04df3baa3ad959277ba00)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:28.550926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:28.596660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1579004868f04df3baa3ad959277ba00', 'request_id': 'req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.603732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1579004868f04df3baa3ad959277ba00', 'request_id': 'req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.609116 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1579004868f04df3baa3ad959277ba00', 'request_id': 'req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.619508 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] The token cache is being invalidate because project 1579004868f04df3baa3ad959277ba00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:28.619792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.620395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9c7a758b-5755-4109-8be3-9ccf25ce4ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:28.621984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1177/2384] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:28 2022] DELETE /identity/v3/projects/1579004868f04df3baa3ad959277ba00 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:28.627009 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba444b-558f-499f-b278-bda62ecf2771 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:28.627317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba444b-558f-499f-b278-bda62ecf2771 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:28.627596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba444b-558f-499f-b278-bda62ecf2771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:28.645015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-dfba444b-558f-499f-b278-bda62ecf2771 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:28.646270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-dfba444b-558f-499f-b278-bda62ecf2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:28.705747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1208/2385] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:28.713804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6f9a-2573-4b86-81c4-c1da831d7808 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:28.714152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6f9a-2573-4b86-81c4-c1da831d7808 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:28.714431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6f9a-2573-4b86-81c4-c1da831d7808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:28.733814 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b30a6f9a-2573-4b86-81c4-c1da831d7808 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:28.735005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b30a6f9a-2573-4b86-81c4-c1da831d7808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:28.742823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1178/2386] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:28.753770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba444b-558f-499f-b278-bda62ecf2771 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:28.757873 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba444b-558f-499f-b278-bda62ecf2771 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:28.762688 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569de55-6e32-4098-aed6-2b7c8de07f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:28.763189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569de55-6e32-4098-aed6-2b7c8de07f48 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:28.763470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569de55-6e32-4098-aed6-2b7c8de07f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:28.763746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569de55-6e32-4098-aed6-2b7c8de07f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:28.764474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569de55-6e32-4098-aed6-2b7c8de07f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:28.764785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569de55-6e32-4098-aed6-2b7c8de07f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:28.766404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569de55-6e32-4098-aed6-2b7c8de07f48 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:28.778387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1209/2387] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:05:28.783430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a6f9a-2573-4b86-81c4-c1da831d7808 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:28.793174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a6f9a-2573-4b86-81c4-c1da831d7808 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:28.798199 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05434eb1-a48e-421f-a23b-a806b0c74bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:28.798865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05434eb1-a48e-421f-a23b-a806b0c74bdd admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:28.799219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05434eb1-a48e-421f-a23b-a806b0c74bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:28.799621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05434eb1-a48e-421f-a23b-a806b0c74bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:28.800450 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05434eb1-a48e-421f-a23b-a806b0c74bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:28.802445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05434eb1-a48e-421f-a23b-a806b0c74bdd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:28.828733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1179/2388] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:28 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:28.832947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569de55-6e32-4098-aed6-2b7c8de07f48 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:28.844320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569de55-6e32-4098-aed6-2b7c8de07f48 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:28.901436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438318-8317-4ca2-b45d-531411f2d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:28.902239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438318-8317-4ca2-b45d-531411f2d8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:28.902633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438318-8317-4ca2-b45d-531411f2d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:28.902913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438318-8317-4ca2-b45d-531411f2d8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:28.903596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4438318-8317-4ca2-b45d-531411f2d8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:28.905865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4438318-8317-4ca2-b45d-531411f2d8d9 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:28.926427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1210/2389] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:28 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:28.930409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05434eb1-a48e-421f-a23b-a806b0c74bdd admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:28.940940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05434eb1-a48e-421f-a23b-a806b0c74bdd admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:28.946368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04d64a-2f6b-4837-9189-77b1310979ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:28.947059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04d64a-2f6b-4837-9189-77b1310979ec admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:28.947338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04d64a-2f6b-4837-9189-77b1310979ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:28.947630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04d64a-2f6b-4837-9189-77b1310979ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:28.948468 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04d64a-2f6b-4837-9189-77b1310979ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:28.950088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04d64a-2f6b-4837-9189-77b1310979ec admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:28.964476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1180/2390] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:28.965680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438318-8317-4ca2-b45d-531411f2d8d9 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:28.976746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438318-8317-4ca2-b45d-531411f2d8d9 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:28.982662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333a756-47c7-4991-a2c1-cf2d4e776479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:28.983404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333a756-47c7-4991-a2c1-cf2d4e776479 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:28.983764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333a756-47c7-4991-a2c1-cf2d4e776479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:28.984116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333a756-47c7-4991-a2c1-cf2d4e776479 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:28.985047 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333a756-47c7-4991-a2c1-cf2d4e776479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:28.986656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333a756-47c7-4991-a2c1-cf2d4e776479 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:29.009091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1211/2391] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:29.013359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04d64a-2f6b-4837-9189-77b1310979ec admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:29.025556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04d64a-2f6b-4837-9189-77b1310979ec admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:29.031313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f127b3-2be3-4ba5-b1f4-fd77647d1bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:29.037397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f127b3-2be3-4ba5-b1f4-fd77647d1bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:29.037715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f127b3-2be3-4ba5-b1f4-fd77647d1bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:29.037998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f127b3-2be3-4ba5-b1f4-fd77647d1bc1 admin admin] PATH_INFO: `/v3/projects/d11cc0120ce24e0783420cbb00432284/users/a4b67802ec084cc58c230a238cac5346/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:29.052949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f127b3-2be3-4ba5-b1f4-fd77647d1bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11cc0120ce24e0783420cbb00432284, user_id=a4b67802ec084cc58c230a238cac5346, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:29.056209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f127b3-2be3-4ba5-b1f4-fd77647d1bc1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:29.072309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1181/2392] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:29 2022] PUT /identity/v3/projects/d11cc0120ce24e0783420cbb00432284/users/a4b67802ec084cc58c230a238cac5346/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:29.082484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f78aa9-26a5-4c26-9de3-593842bd5d6a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:29.082778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f78aa9-26a5-4c26-9de3-593842bd5d6a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:29.083052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f78aa9-26a5-4c26-9de3-593842bd5d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:29.112248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c4f78aa9-26a5-4c26-9de3-593842bd5d6a None None] MFA Rules not processed for user `a4b67802ec084cc58c230a238cac5346`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:29.113456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c4f78aa9-26a5-4c26-9de3-593842bd5d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:29.183982 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1212/2393] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:29.194688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f127b3-2be3-4ba5-b1f4-fd77647d1bc1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:29.197189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f0f127b3-2be3-4ba5-b1f4-fd77647d1bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:29.253619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f127b3-2be3-4ba5-b1f4-fd77647d1bc1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:29.257415 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7634a-c760-4c23-bbbf-ab3944996c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:29.258098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7634a-c760-4c23-bbbf-ab3944996c1b service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:29.258386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7634a-c760-4c23-bbbf-ab3944996c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:29.259147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7634a-c760-4c23-bbbf-ab3944996c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:29.267083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7634a-c760-4c23-bbbf-ab3944996c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:29.268522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7634a-c760-4c23-bbbf-ab3944996c1b service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:29.277579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1182/2394] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:37.778536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f78aa9-26a5-4c26-9de3-593842bd5d6a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:37.838421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f78aa9-26a5-4c26-9de3-593842bd5d6a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:37.842939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:37.843785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:37.844065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:37.844339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] PATH_INFO: `/v3/users/a4b67802ec084cc58c230a238cac5346` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:37.845500 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b67802ec084cc58c230a238cac5346)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:37.847432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:37.892139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b67802ec084cc58c230a238cac5346'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:37.892775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b67802ec084cc58c230a238cac5346'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:37.904017 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b67802ec084cc58c230a238cac5346'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:37.904639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b67802ec084cc58c230a238cac5346'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:37.911943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b67802ec084cc58c230a238cac5346'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:37.924130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1213/2395] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:37 2022] DELETE /identity/v3/users/a4b67802ec084cc58c230a238cac5346 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:37.928556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0073059-2cd6-4020-85bf-b4a5d709021d None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:37.929062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0073059-2cd6-4020-85bf-b4a5d709021d None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:37.929168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0073059-2cd6-4020-85bf-b4a5d709021d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:37.947883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b0073059-2cd6-4020-85bf-b4a5d709021d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:37.949057 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b0073059-2cd6-4020-85bf-b4a5d709021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:38.004544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1183/2396] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:38.016320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:38.017845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:38.077101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb794fb7-5373-4205-97f1-f65a6f815cf4 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:38.080827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31489fa8-0cf8-416a-8f8e-8c9fc4e09204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:38.081470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31489fa8-0cf8-416a-8f8e-8c9fc4e09204 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:38.081783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31489fa8-0cf8-416a-8f8e-8c9fc4e09204 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:38.082062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31489fa8-0cf8-416a-8f8e-8c9fc4e09204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:38.091127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31489fa8-0cf8-416a-8f8e-8c9fc4e09204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:38.092552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31489fa8-0cf8-416a-8f8e-8c9fc4e09204 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:38.101970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1214/2397] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:38.267716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0073059-2cd6-4020-85bf-b4a5d709021d None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:38.278928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0073059-2cd6-4020-85bf-b4a5d709021d None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:38.284220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46f73-9b3b-41e2-93a8-38b1b9c8d070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:38.284880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46f73-9b3b-41e2-93a8-38b1b9c8d070 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:38.285167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46f73-9b3b-41e2-93a8-38b1b9c8d070 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:38.285612 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46f73-9b3b-41e2-93a8-38b1b9c8d070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:38.287914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-38f46f73-9b3b-41e2-93a8-38b1b9c8d070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:38.305711 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f46f73-9b3b-41e2-93a8-38b1b9c8d070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:38.307647 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f46f73-9b3b-41e2-93a8-38b1b9c8d070 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:38.319092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1184/2398] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:38.527725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31489fa8-0cf8-416a-8f8e-8c9fc4e09204 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:38.530620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-31489fa8-0cf8-416a-8f8e-8c9fc4e09204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:38.547611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31489fa8-0cf8-416a-8f8e-8c9fc4e09204 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:38.566435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:38.567585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:38.568104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:38.568495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] PATH_INFO: `/v3/projects/d11cc0120ce24e0783420cbb00432284` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:38.569898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11cc0120ce24e0783420cbb00432284)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:38.572900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:38.625393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11cc0120ce24e0783420cbb00432284', 'request_id': 'req-dce17681-e9d4-4519-8e8e-9796ab4ecf23'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:38.634305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11cc0120ce24e0783420cbb00432284', 'request_id': 'req-dce17681-e9d4-4519-8e8e-9796ab4ecf23'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:38.641344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11cc0120ce24e0783420cbb00432284', 'request_id': 'req-dce17681-e9d4-4519-8e8e-9796ab4ecf23'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:38.653569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] The token cache is being invalidate because project d11cc0120ce24e0783420cbb00432284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:38.654486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:38.655570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dce17681-e9d4-4519-8e8e-9796ab4ecf23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:38.657263 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1215/2399] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:38 2022] DELETE /identity/v3/projects/d11cc0120ce24e0783420cbb00432284 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:38.662145 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fbad5-8769-4ab4-aaf5-bad3e2988d8b None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:38.662441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fbad5-8769-4ab4-aaf5-bad3e2988d8b None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:38.662724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fbad5-8769-4ab4-aaf5-bad3e2988d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:38.680845 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8f0fbad5-8769-4ab4-aaf5-bad3e2988d8b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:38.682382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8f0fbad5-8769-4ab4-aaf5-bad3e2988d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:38.746607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1185/2400] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:38.754511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b095f2-824d-46eb-8c60-3c3b94ddcd02 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:38.754819 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b095f2-824d-46eb-8c60-3c3b94ddcd02 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:38.755098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b095f2-824d-46eb-8c60-3c3b94ddcd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:38.774223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f9b095f2-824d-46eb-8c60-3c3b94ddcd02 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:38.775433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f9b095f2-824d-46eb-8c60-3c3b94ddcd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:38.783769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1216/2401] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:38.788274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fbad5-8769-4ab4-aaf5-bad3e2988d8b None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:38.798788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fbad5-8769-4ab4-aaf5-bad3e2988d8b None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:38.803966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc6b37-3dfc-4d7e-95ca-f3cf8fe3ed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:38.804746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc6b37-3dfc-4d7e-95ca-f3cf8fe3ed6d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:38.805518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc6b37-3dfc-4d7e-95ca-f3cf8fe3ed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:38.805817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc6b37-3dfc-4d7e-95ca-f3cf8fe3ed6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:38.806559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc6b37-3dfc-4d7e-95ca-f3cf8fe3ed6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:38.806864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc6b37-3dfc-4d7e-95ca-f3cf8fe3ed6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:38.808595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc6b37-3dfc-4d7e-95ca-f3cf8fe3ed6d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:38.821337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1186/2402] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:38.825809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b095f2-824d-46eb-8c60-3c3b94ddcd02 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:38.835908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b095f2-824d-46eb-8c60-3c3b94ddcd02 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:38.841906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774926-f3c1-4606-9f76-68fd7c2c5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:38.842682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774926-f3c1-4606-9f76-68fd7c2c5442 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:38.842961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774926-f3c1-4606-9f76-68fd7c2c5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:38.843413 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774926-f3c1-4606-9f76-68fd7c2c5442 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:38.844108 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45774926-f3c1-4606-9f76-68fd7c2c5442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:38.846021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45774926-f3c1-4606-9f76-68fd7c2c5442 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:38.886280 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1217/2403] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:38 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:38.887495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc6b37-3dfc-4d7e-95ca-f3cf8fe3ed6d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:38.897171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc6b37-3dfc-4d7e-95ca-f3cf8fe3ed6d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:38.955662 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de5ef3-0f98-42c9-8daf-ff84d308db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:38.956364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5ef3-0f98-42c9-8daf-ff84d308db87 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:38.956641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5ef3-0f98-42c9-8daf-ff84d308db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:38.956918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5ef3-0f98-42c9-8daf-ff84d308db87 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:38.957643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de5ef3-0f98-42c9-8daf-ff84d308db87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:38.959614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de5ef3-0f98-42c9-8daf-ff84d308db87 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:38.985705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1187/2404] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:38 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:38.987894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774926-f3c1-4606-9f76-68fd7c2c5442 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:38.998983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774926-f3c1-4606-9f76-68fd7c2c5442 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.004368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa08e7-91df-4e65-9b1a-087a37ae9b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.005099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa08e7-91df-4e65-9b1a-087a37ae9b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.005463 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa08e7-91df-4e65-9b1a-087a37ae9b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.005840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa08e7-91df-4e65-9b1a-087a37ae9b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.006653 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa08e7-91df-4e65-9b1a-087a37ae9b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.008421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa08e7-91df-4e65-9b1a-087a37ae9b79 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.021824 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1218/2405] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:39.023292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de5ef3-0f98-42c9-8daf-ff84d308db87 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.034214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de5ef3-0f98-42c9-8daf-ff84d308db87 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.040058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaa4f1-48a2-4997-a1d1-6bff30d181b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.040732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaa4f1-48a2-4997-a1d1-6bff30d181b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.041147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaa4f1-48a2-4997-a1d1-6bff30d181b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.041432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaa4f1-48a2-4997-a1d1-6bff30d181b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.042224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaa4f1-48a2-4997-a1d1-6bff30d181b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.043837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaa4f1-48a2-4997-a1d1-6bff30d181b3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.054581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1188/2406] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:39.059816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa08e7-91df-4e65-9b1a-087a37ae9b79 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.070465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa08e7-91df-4e65-9b1a-087a37ae9b79 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.081262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5f7d1-092e-45e5-bff1-02d4a3a83bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.082788 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5f7d1-092e-45e5-bff1-02d4a3a83bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.083060 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5f7d1-092e-45e5-bff1-02d4a3a83bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.083334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5f7d1-092e-45e5-bff1-02d4a3a83bd9 admin admin] PATH_INFO: `/v3/projects/da214f85decb42328c4c82c775376630/users/890ccc4d66fa4dabb58db67995d997a4/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.102930 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5f7d1-092e-45e5-bff1-02d4a3a83bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da214f85decb42328c4c82c775376630, user_id=890ccc4d66fa4dabb58db67995d997a4, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.105831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5f7d1-092e-45e5-bff1-02d4a3a83bd9 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.122790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1219/2407] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:39 2022] PUT /identity/v3/projects/da214f85decb42328c4c82c775376630/users/890ccc4d66fa4dabb58db67995d997a4/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:39.132417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996797a-0485-485b-9fb3-3b94cf19d5bc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.132788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996797a-0485-485b-9fb3-3b94cf19d5bc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.133124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996797a-0485-485b-9fb3-3b94cf19d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.162520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8996797a-0485-485b-9fb3-3b94cf19d5bc None None] MFA Rules not processed for user `890ccc4d66fa4dabb58db67995d997a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:39.163843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8996797a-0485-485b-9fb3-3b94cf19d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:39.232035 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1189/2408] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:39.236540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5f7d1-092e-45e5-bff1-02d4a3a83bd9 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.298548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5f7d1-092e-45e5-bff1-02d4a3a83bd9 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.303139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa20da-787a-4a04-8e19-be55bdc9b590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.303804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa20da-787a-4a04-8e19-be55bdc9b590 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.304084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa20da-787a-4a04-8e19-be55bdc9b590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.304359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa20da-787a-4a04-8e19-be55bdc9b590 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.305084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa20da-787a-4a04-8e19-be55bdc9b590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.307039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa20da-787a-4a04-8e19-be55bdc9b590 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.333881 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1220/2409] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:39 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:39.338515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996797a-0485-485b-9fb3-3b94cf19d5bc None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.349269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996797a-0485-485b-9fb3-3b94cf19d5bc None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.405737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584de749-fb11-4d0f-984a-961dbf08278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.406409 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584de749-fb11-4d0f-984a-961dbf08278f admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.406691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584de749-fb11-4d0f-984a-961dbf08278f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.406961 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584de749-fb11-4d0f-984a-961dbf08278f admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.407654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584de749-fb11-4d0f-984a-961dbf08278f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.409600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584de749-fb11-4d0f-984a-961dbf08278f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.428960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1190/2410] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:39 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:39.433384 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa20da-787a-4a04-8e19-be55bdc9b590 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.443349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa20da-787a-4a04-8e19-be55bdc9b590 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.448476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13162c21-5e7a-4761-8902-266837455d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.449116 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13162c21-5e7a-4761-8902-266837455d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.449393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13162c21-5e7a-4761-8902-266837455d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.449704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13162c21-5e7a-4761-8902-266837455d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.450415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13162c21-5e7a-4761-8902-266837455d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.451998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13162c21-5e7a-4761-8902-266837455d54 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.463074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1221/2411] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:05:39.467134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584de749-fb11-4d0f-984a-961dbf08278f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.480153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584de749-fb11-4d0f-984a-961dbf08278f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.484638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b19fb-4411-4deb-83a3-6c27672673b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.485627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b19fb-4411-4deb-83a3-6c27672673b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.485983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b19fb-4411-4deb-83a3-6c27672673b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.486330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b19fb-4411-4deb-83a3-6c27672673b2 admin admin] PATH_INFO: `/v3/projects/00898d846cde44268688f0f480f234cc/users/1acc4257ea6245a69de091cd6dc7a66d/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.501599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b19fb-4411-4deb-83a3-6c27672673b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00898d846cde44268688f0f480f234cc, user_id=1acc4257ea6245a69de091cd6dc7a66d, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.504250 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b19fb-4411-4deb-83a3-6c27672673b2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.518084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1191/2412] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:39 2022] PUT /identity/v3/projects/00898d846cde44268688f0f480f234cc/users/1acc4257ea6245a69de091cd6dc7a66d/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:39.521991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13162c21-5e7a-4761-8902-266837455d54 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.531941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13162c21-5e7a-4761-8902-266837455d54 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.589296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8446103-3dec-4cba-901e-813ea15e5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.589916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8446103-3dec-4cba-901e-813ea15e5150 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.590196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8446103-3dec-4cba-901e-813ea15e5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.590469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8446103-3dec-4cba-901e-813ea15e5150 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.591188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8446103-3dec-4cba-901e-813ea15e5150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.592790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8446103-3dec-4cba-901e-813ea15e5150 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.602565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1222/2413] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:39.606983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b19fb-4411-4deb-83a3-6c27672673b2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.618017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b19fb-4411-4deb-83a3-6c27672673b2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.622633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77018f4b-025e-49ca-97b3-bac1e5e792b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.623526 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77018f4b-025e-49ca-97b3-bac1e5e792b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.623818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77018f4b-025e-49ca-97b3-bac1e5e792b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.624090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77018f4b-025e-49ca-97b3-bac1e5e792b3 admin admin] PATH_INFO: `/v3/projects/00898d846cde44268688f0f480f234cc/users/1acc4257ea6245a69de091cd6dc7a66d/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.626091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77018f4b-025e-49ca-97b3-bac1e5e792b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00898d846cde44268688f0f480f234cc, user_id=1acc4257ea6245a69de091cd6dc7a66d, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.628729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77018f4b-025e-49ca-97b3-bac1e5e792b3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.643851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1192/2414] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:39 2022] PUT /identity/v3/projects/00898d846cde44268688f0f480f234cc/users/1acc4257ea6245a69de091cd6dc7a66d/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:39.655311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23a7c-9d52-4466-abcb-7d03adaa4a02 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.655661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23a7c-9d52-4466-abcb-7d03adaa4a02 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.655935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23a7c-9d52-4466-abcb-7d03adaa4a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.687178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f9e23a7c-9d52-4466-abcb-7d03adaa4a02 None None] MFA Rules not processed for user `1acc4257ea6245a69de091cd6dc7a66d`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:39.688591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f9e23a7c-9d52-4466-abcb-7d03adaa4a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:39.764291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1223/2415] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:39.775937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77018f4b-025e-49ca-97b3-bac1e5e792b3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.777737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-77018f4b-025e-49ca-97b3-bac1e5e792b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:39.841901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77018f4b-025e-49ca-97b3-bac1e5e792b3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.845552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38694ce-e7c9-4e12-99fc-a2cf48ecec76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.846210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38694ce-e7c9-4e12-99fc-a2cf48ecec76 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.846492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38694ce-e7c9-4e12-99fc-a2cf48ecec76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.846763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38694ce-e7c9-4e12-99fc-a2cf48ecec76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.856372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38694ce-e7c9-4e12-99fc-a2cf48ecec76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.857910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38694ce-e7c9-4e12-99fc-a2cf48ecec76 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:39.869175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1193/2416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:39.905502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d48de-40e0-4d4f-ac49-424acec821c0 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.906043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d48de-40e0-4d4f-ac49-424acec821c0 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.906311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d48de-40e0-4d4f-ac49-424acec821c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.915451 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38694ce-e7c9-4e12-99fc-a2cf48ecec76 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:39.916845 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c38694ce-e7c9-4e12-99fc-a2cf48ecec76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:39.925322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-0a4d48de-40e0-4d4f-ac49-424acec821c0 None None] MFA Rules not processed for user `4afe3e5522534562ad835af83b830ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:39.926684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0a4d48de-40e0-4d4f-ac49-424acec821c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:39.928067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38694ce-e7c9-4e12-99fc-a2cf48ecec76 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:39.932907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5fc4-e182-4db6-9a00-be361a4d19c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:39.933579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5fc4-e182-4db6-9a00-be361a4d19c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:39.933870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5fc4-e182-4db6-9a00-be361a4d19c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:39.934142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5fc4-e182-4db6-9a00-be361a4d19c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:39.987908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1224/2417] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:39.993759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5fc4-e182-4db6-9a00-be361a4d19c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:39.995196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5fc4-e182-4db6-9a00-be361a4d19c4 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:40.004267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1194/2418] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:42.177257 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d48de-40e0-4d4f-ac49-424acec821c0 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:42.178685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0a4d48de-40e0-4d4f-ac49-424acec821c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:42.245479 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d48de-40e0-4d4f-ac49-424acec821c0 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:42.249999 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:42.250864 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:42.251151 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:42.251429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] PATH_INFO: `/v3/users/2c202a7f2c484cd3b0363b75c1a673a3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:42.252616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c202a7f2c484cd3b0363b75c1a673a3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:42.254615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:42.301201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c202a7f2c484cd3b0363b75c1a673a3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.301876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c202a7f2c484cd3b0363b75c1a673a3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.313636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c202a7f2c484cd3b0363b75c1a673a3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.314288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c202a7f2c484cd3b0363b75c1a673a3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.321951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-b709b9b8-fa7c-439c-820c-9bd5063da7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c202a7f2c484cd3b0363b75c1a673a3'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.333969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1225/2419] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:42 2022] DELETE /identity/v3/users/2c202a7f2c484cd3b0363b75c1a673a3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:42.505412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5fc4-e182-4db6-9a00-be361a4d19c4 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:42.520785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5fc4-e182-4db6-9a00-be361a4d19c4 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:42.584674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:42.585552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:42.585914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:42.586663 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] PATH_INFO: `/v3/projects/a61f3c6e7974486a9f3a4f9d361c5fb6` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:42.587895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a61f3c6e7974486a9f3a4f9d361c5fb6)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:42.589869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:42.638023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'request_id': 'req-68c1733f-821a-4163-9d68-48870e7a9485'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.645818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'request_id': 'req-68c1733f-821a-4163-9d68-48870e7a9485'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.652012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'request_id': 'req-68c1733f-821a-4163-9d68-48870e7a9485'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.663017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] The token cache is being invalidate because project a61f3c6e7974486a9f3a4f9d361c5fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:42.663300 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.663941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-68c1733f-821a-4163-9d68-48870e7a9485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:42.666073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1195/2420] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:42 2022] DELETE /identity/v3/projects/a61f3c6e7974486a9f3a4f9d361c5fb6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:42.670939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f595-e5cc-411a-b656-844d19ed0323 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:42.671219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f595-e5cc-411a-b656-844d19ed0323 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:42.671489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f595-e5cc-411a-b656-844d19ed0323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:42.688840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4642f595-e5cc-411a-b656-844d19ed0323 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:42.690097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4642f595-e5cc-411a-b656-844d19ed0323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:42.749355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1226/2421] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:42.757209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf9143-7043-45f1-a484-f9d909fac805 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:42.757506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf9143-7043-45f1-a484-f9d909fac805 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:42.758420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf9143-7043-45f1-a484-f9d909fac805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:42.776671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7acf9143-7043-45f1-a484-f9d909fac805 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:42.777937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7acf9143-7043-45f1-a484-f9d909fac805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:42.786282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1196/2422] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:42.791023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642f595-e5cc-411a-b656-844d19ed0323 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:42.800519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642f595-e5cc-411a-b656-844d19ed0323 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:42.805334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696398b-ca99-4e57-a9a1-6fc3c3412601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:42.806077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696398b-ca99-4e57-a9a1-6fc3c3412601 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:42.806363 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696398b-ca99-4e57-a9a1-6fc3c3412601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:42.806640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696398b-ca99-4e57-a9a1-6fc3c3412601 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:42.807359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696398b-ca99-4e57-a9a1-6fc3c3412601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:42.807671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696398b-ca99-4e57-a9a1-6fc3c3412601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:42.809294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696398b-ca99-4e57-a9a1-6fc3c3412601 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:42.826353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf9143-7043-45f1-a484-f9d909fac805 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:42.829651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1227/2423] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:42.836907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf9143-7043-45f1-a484-f9d909fac805 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:42.841798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68046e-405e-48dc-8924-b16ab501d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:42.842538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68046e-405e-48dc-8924-b16ab501d069 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:42.842890 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68046e-405e-48dc-8924-b16ab501d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:42.843253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68046e-405e-48dc-8924-b16ab501d069 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:42.844004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68046e-405e-48dc-8924-b16ab501d069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:42.845988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68046e-405e-48dc-8924-b16ab501d069 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:42.874517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1197/2424] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:42 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:42.875692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696398b-ca99-4e57-a9a1-6fc3c3412601 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:42.886260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696398b-ca99-4e57-a9a1-6fc3c3412601 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:42.943202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04394084-7f95-4ed1-b381-24fbf59c025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:42.943736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04394084-7f95-4ed1-b381-24fbf59c025d admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:42.944024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04394084-7f95-4ed1-b381-24fbf59c025d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:42.944295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04394084-7f95-4ed1-b381-24fbf59c025d admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:42.944978 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04394084-7f95-4ed1-b381-24fbf59c025d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:42.947496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04394084-7f95-4ed1-b381-24fbf59c025d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:42.971603 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1228/2425] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:42 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:42.976458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68046e-405e-48dc-8924-b16ab501d069 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:42.988014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68046e-405e-48dc-8924-b16ab501d069 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:42.993887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9f3f-c6b8-4695-883b-568c05d8a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:42.994562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9f3f-c6b8-4695-883b-568c05d8a26f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:42.994846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9f3f-c6b8-4695-883b-568c05d8a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:42.995125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9f3f-c6b8-4695-883b-568c05d8a26f admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:42.995851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e9f3f-c6b8-4695-883b-568c05d8a26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:42.997679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e9f3f-c6b8-4695-883b-568c05d8a26f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.012131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1198/2426] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:43.014096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04394084-7f95-4ed1-b381-24fbf59c025d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.025538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04394084-7f95-4ed1-b381-24fbf59c025d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.030665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a28813-4f0e-49d3-aaa3-04bcdf5975e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.031654 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28813-4f0e-49d3-aaa3-04bcdf5975e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.032168 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28813-4f0e-49d3-aaa3-04bcdf5975e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.032736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28813-4f0e-49d3-aaa3-04bcdf5975e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.033712 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a28813-4f0e-49d3-aaa3-04bcdf5975e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.037604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a28813-4f0e-49d3-aaa3-04bcdf5975e3 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.054629 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1229/2427] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:43.058782 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9f3f-c6b8-4695-883b-568c05d8a26f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.069443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9f3f-c6b8-4695-883b-568c05d8a26f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.076196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedaaaf-aed2-41c8-885c-709502971922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.077340 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedaaaf-aed2-41c8-885c-709502971922 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.077862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedaaaf-aed2-41c8-885c-709502971922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.078325 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedaaaf-aed2-41c8-885c-709502971922 admin admin] PATH_INFO: `/v3/projects/35b0fb5356b44c4eba944a050d1214be/users/f4b5fee957954cadae1522c078166ddd/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.094554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedaaaf-aed2-41c8-885c-709502971922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b0fb5356b44c4eba944a050d1214be, user_id=f4b5fee957954cadae1522c078166ddd, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.098126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedaaaf-aed2-41c8-885c-709502971922 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.121595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1199/2428] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:43 2022] PUT /identity/v3/projects/35b0fb5356b44c4eba944a050d1214be/users/f4b5fee957954cadae1522c078166ddd/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:43.129568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cbe49-db23-472d-aafe-4ddd45f93157 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.130447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cbe49-db23-472d-aafe-4ddd45f93157 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.130447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cbe49-db23-472d-aafe-4ddd45f93157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.159005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b45cbe49-db23-472d-aafe-4ddd45f93157 None None] MFA Rules not processed for user `f4b5fee957954cadae1522c078166ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:43.165853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b45cbe49-db23-472d-aafe-4ddd45f93157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:43.238581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1230/2429] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:43.244013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedaaaf-aed2-41c8-885c-709502971922 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.322472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedaaaf-aed2-41c8-885c-709502971922 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.330971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ec1a0-a701-4ee5-a0bd-5ca94fef5a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.331655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ec1a0-a701-4ee5-a0bd-5ca94fef5a3d admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.331938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ec1a0-a701-4ee5-a0bd-5ca94fef5a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.332209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ec1a0-a701-4ee5-a0bd-5ca94fef5a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.332986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ec1a0-a701-4ee5-a0bd-5ca94fef5a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.334878 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ec1a0-a701-4ee5-a0bd-5ca94fef5a3d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.366958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1200/2430] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:43 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:43.368129 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cbe49-db23-472d-aafe-4ddd45f93157 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.379036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cbe49-db23-472d-aafe-4ddd45f93157 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.442744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7329-4b32-48b6-aac9-6ca8a5b4d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.443435 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7329-4b32-48b6-aac9-6ca8a5b4d985 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.443718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7329-4b32-48b6-aac9-6ca8a5b4d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.443996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7329-4b32-48b6-aac9-6ca8a5b4d985 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.444706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc7329-4b32-48b6-aac9-6ca8a5b4d985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.446800 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc7329-4b32-48b6-aac9-6ca8a5b4d985 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.470233 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1231/2431] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:43 2022] POST /identity/v3/users => generated 308 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:43.474455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ec1a0-a701-4ee5-a0bd-5ca94fef5a3d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.486986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ec1a0-a701-4ee5-a0bd-5ca94fef5a3d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.492900 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8eb13-0823-4244-94b4-3e2d8629416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.493623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8eb13-0823-4244-94b4-3e2d8629416b admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.493907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8eb13-0823-4244-94b4-3e2d8629416b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.494184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8eb13-0823-4244-94b4-3e2d8629416b admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.494952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8eb13-0823-4244-94b4-3e2d8629416b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.496811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8eb13-0823-4244-94b4-3e2d8629416b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.509412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1201/2432] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:43.513595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7329-4b32-48b6-aac9-6ca8a5b4d985 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.524840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7329-4b32-48b6-aac9-6ca8a5b4d985 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.535894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31e997-30f6-46c4-bb72-d3a58ae5e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.537423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31e997-30f6-46c4-bb72-d3a58ae5e440 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.537943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31e997-30f6-46c4-bb72-d3a58ae5e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.538455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31e997-30f6-46c4-bb72-d3a58ae5e440 admin admin] PATH_INFO: `/v3/projects/dc210ddc26cd4cc3b4776bd9254a05b2/users/8d99383a3a30491dbeb2948da8080eec/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.567474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31e997-30f6-46c4-bb72-d3a58ae5e440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc210ddc26cd4cc3b4776bd9254a05b2, user_id=8d99383a3a30491dbeb2948da8080eec, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.572812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31e997-30f6-46c4-bb72-d3a58ae5e440 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.596843 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1232/2433] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:43 2022] PUT /identity/v3/projects/dc210ddc26cd4cc3b4776bd9254a05b2/users/8d99383a3a30491dbeb2948da8080eec/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:43.600665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8eb13-0823-4244-94b4-3e2d8629416b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.610666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8eb13-0823-4244-94b4-3e2d8629416b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.674066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31e997-30f6-46c4-bb72-d3a58ae5e440 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.675809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7a31e997-30f6-46c4-bb72-d3a58ae5e440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:43.679999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552bfbb-cb4e-4b18-aeb3-5ce7d51319fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.680761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552bfbb-cb4e-4b18-aeb3-5ce7d51319fd admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.681212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552bfbb-cb4e-4b18-aeb3-5ce7d51319fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.681866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552bfbb-cb4e-4b18-aeb3-5ce7d51319fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.683317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552bfbb-cb4e-4b18-aeb3-5ce7d51319fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.685247 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552bfbb-cb4e-4b18-aeb3-5ce7d51319fd admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.690041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31e997-30f6-46c4-bb72-d3a58ae5e440 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.696342 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.697550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.697665 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.697904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] PATH_INFO: `/v3/users/890ccc4d66fa4dabb58db67995d997a4` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.701381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1202/2434] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:43.701558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890ccc4d66fa4dabb58db67995d997a4)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.701558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.702453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552bfbb-cb4e-4b18-aeb3-5ce7d51319fd admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.713184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552bfbb-cb4e-4b18-aeb3-5ce7d51319fd admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.718041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215e763-f35c-48e3-ab51-6e3ead545bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.719108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215e763-f35c-48e3-ab51-6e3ead545bac admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.719703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215e763-f35c-48e3-ab51-6e3ead545bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.719974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215e763-f35c-48e3-ab51-6e3ead545bac admin admin] PATH_INFO: `/v3/projects/dc210ddc26cd4cc3b4776bd9254a05b2/users/8d99383a3a30491dbeb2948da8080eec/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.722337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215e763-f35c-48e3-ab51-6e3ead545bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc210ddc26cd4cc3b4776bd9254a05b2, user_id=8d99383a3a30491dbeb2948da8080eec, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.725892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215e763-f35c-48e3-ab51-6e3ead545bac admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.745619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1203/2435] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:43 2022] PUT /identity/v3/projects/dc210ddc26cd4cc3b4776bd9254a05b2/users/8d99383a3a30491dbeb2948da8080eec/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:43.748047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ba38-4097-4fd7-b19b-004e7b3f4154 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.748443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ba38-4097-4fd7-b19b-004e7b3f4154 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.748818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ba38-4097-4fd7-b19b-004e7b3f4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.754366 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890ccc4d66fa4dabb58db67995d997a4'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:43.756122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890ccc4d66fa4dabb58db67995d997a4'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:43.770576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890ccc4d66fa4dabb58db67995d997a4'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:43.771355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890ccc4d66fa4dabb58db67995d997a4'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:43.776730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-00e8ba38-4097-4fd7-b19b-004e7b3f4154 None None] MFA Rules not processed for user `8d99383a3a30491dbeb2948da8080eec`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:43.777968 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00e8ba38-4097-4fd7-b19b-004e7b3f4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:43.781304 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-5715a6a5-9137-4a1f-9200-db2c612cc0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890ccc4d66fa4dabb58db67995d997a4'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:43.794260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1233/2436] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:43 2022] DELETE /identity/v3/users/890ccc4d66fa4dabb58db67995d997a4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:43.798657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b831-43c8-48eb-8cd8-3853bc0760e4 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.798946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b831-43c8-48eb-8cd8-3853bc0760e4 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.799218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b831-43c8-48eb-8cd8-3853bc0760e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.816686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f743b831-43c8-48eb-8cd8-3853bc0760e4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:43.817915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f743b831-43c8-48eb-8cd8-3853bc0760e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:43.856631 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1204/2437] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:43.867952 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8ba38-4097-4fd7-b19b-004e7b3f4154 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.869330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00e8ba38-4097-4fd7-b19b-004e7b3f4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:43.880617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1234/2438] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:43.890446 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743b831-43c8-48eb-8cd8-3853bc0760e4 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:43.891857 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f743b831-43c8-48eb-8cd8-3853bc0760e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:43.930272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8ba38-4097-4fd7-b19b-004e7b3f4154 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.952176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743b831-43c8-48eb-8cd8-3853bc0760e4 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:43.957055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daa461-89c5-4b6c-8139-71934ce383f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.957737 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daa461-89c5-4b6c-8139-71934ce383f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.958032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daa461-89c5-4b6c-8139-71934ce383f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.958287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daa461-89c5-4b6c-8139-71934ce383f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:43.969492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daa461-89c5-4b6c-8139-71934ce383f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:43.970960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daa461-89c5-4b6c-8139-71934ce383f8 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:43.980922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369651-52e9-494f-adb4-8f9f9bfb646e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:43.981131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1235/2439] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:43.982088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369651-52e9-494f-adb4-8f9f9bfb646e service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:43.983031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369651-52e9-494f-adb4-8f9f9bfb646e service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:43.983447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369651-52e9-494f-adb4-8f9f9bfb646e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:44.047005 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08369651-52e9-494f-adb4-8f9f9bfb646e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:44.048627 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08369651-52e9-494f-adb4-8f9f9bfb646e service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:44.060553 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1205/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:43 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:44.237640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daa461-89c5-4b6c-8139-71934ce383f8 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:44.239055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-22daa461-89c5-4b6c-8139-71934ce383f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:44.251821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daa461-89c5-4b6c-8139-71934ce383f8 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:44.256634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:44.257577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:44.258683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:44.259120 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] PATH_INFO: `/v3/users/f4b5fee957954cadae1522c078166ddd` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:44.260784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b5fee957954cadae1522c078166ddd)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:44.262884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:44.271237 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369651-52e9-494f-adb4-8f9f9bfb646e service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:44.272785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-08369651-52e9-494f-adb4-8f9f9bfb646e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:44.288861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369651-52e9-494f-adb4-8f9f9bfb646e service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:44.294269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:44.295556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:44.295847 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:44.296193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] PATH_INFO: `/v3/projects/da214f85decb42328c4c82c775376630` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:44.297848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da214f85decb42328c4c82c775376630)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:44.299951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:44.325127 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b5fee957954cadae1522c078166ddd'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.326352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b5fee957954cadae1522c078166ddd'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.344056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b5fee957954cadae1522c078166ddd'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.344963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b5fee957954cadae1522c078166ddd'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.349923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da214f85decb42328c4c82c775376630', 'request_id': 'req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.354131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7b14d732-9b09-4ea4-b201-c3b8fc176394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b5fee957954cadae1522c078166ddd'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.361072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da214f85decb42328c4c82c775376630', 'request_id': 'req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.373242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da214f85decb42328c4c82c775376630', 'request_id': 'req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.384093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1236/2441] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:44 2022] DELETE /identity/v3/users/f4b5fee957954cadae1522c078166ddd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:44.385759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] The token cache is being invalidate because project da214f85decb42328c4c82c775376630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:44.386139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.387071 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.388459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2db01-a84a-4e22-aeff-1c69b90d7854 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:44.388815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1206/2442] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:44 2022] DELETE /identity/v3/projects/da214f85decb42328c4c82c775376630 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:44.388954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2db01-a84a-4e22-aeff-1c69b90d7854 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:44.389052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2db01-a84a-4e22-aeff-1c69b90d7854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:44.392197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:44.393616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:44.406821 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e1b2db01-a84a-4e22-aeff-1c69b90d7854 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:44.408382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e1b2db01-a84a-4e22-aeff-1c69b90d7854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:44.455543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd0f5e-2e67-4b4c-a748-cc78eff58a75 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:44.465462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1237/2443] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:44.475226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2db01-a84a-4e22-aeff-1c69b90d7854 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:44.476595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e1b2db01-a84a-4e22-aeff-1c69b90d7854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:44.512168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:44.513042 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:44.513325 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:44.513652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] PATH_INFO: `/v3/users/1acc4257ea6245a69de091cd6dc7a66d` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:44.514887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1acc4257ea6245a69de091cd6dc7a66d)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:44.516843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:44.531438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2db01-a84a-4e22-aeff-1c69b90d7854 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:44.535002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98cdb-ad3f-4b6c-aa76-d7f36888474c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:44.535641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98cdb-ad3f-4b6c-aa76-d7f36888474c service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:44.535920 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98cdb-ad3f-4b6c-aa76-d7f36888474c service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:44.536193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98cdb-ad3f-4b6c-aa76-d7f36888474c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:44.546432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98cdb-ad3f-4b6c-aa76-d7f36888474c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:44.547964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98cdb-ad3f-4b6c-aa76-d7f36888474c service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:44.558014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1238/2444] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:44.562805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1acc4257ea6245a69de091cd6dc7a66d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.575174 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1acc4257ea6245a69de091cd6dc7a66d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.581854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1acc4257ea6245a69de091cd6dc7a66d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.582569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1acc4257ea6245a69de091cd6dc7a66d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.590475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1acc4257ea6245a69de091cd6dc7a66d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:44.597795 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1207/2445] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:44 2022] DELETE /identity/v3/users/1acc4257ea6245a69de091cd6dc7a66d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:44.897208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98cdb-ad3f-4b6c-aa76-d7f36888474c service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:44.908048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:44.909444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:44.913282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98cdb-ad3f-4b6c-aa76-d7f36888474c service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:44.994882 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c59a51-da4f-4da7-a512-d1bc13bc3bfb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.001960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.003028 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.003512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.003991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] PATH_INFO: `/v3/projects/35b0fb5356b44c4eba944a050d1214be` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.005193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.005555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b0fb5356b44c4eba944a050d1214be)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.007354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.007659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.007793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.007957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] PATH_INFO: `/v3/projects/00898d846cde44268688f0f480f234cc` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.009147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00898d846cde44268688f0f480f234cc)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.011088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.056988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b0fb5356b44c4eba944a050d1214be', 'request_id': 'req-2177a74a-5227-4f42-bf8a-c7aaf66730d6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.058054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00898d846cde44268688f0f480f234cc', 'request_id': 'req-c565628c-4881-4c07-b95c-11a6410feaf2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.064816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b0fb5356b44c4eba944a050d1214be', 'request_id': 'req-2177a74a-5227-4f42-bf8a-c7aaf66730d6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.067029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00898d846cde44268688f0f480f234cc', 'request_id': 'req-c565628c-4881-4c07-b95c-11a6410feaf2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.075292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00898d846cde44268688f0f480f234cc', 'request_id': 'req-c565628c-4881-4c07-b95c-11a6410feaf2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.075635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b0fb5356b44c4eba944a050d1214be', 'request_id': 'req-2177a74a-5227-4f42-bf8a-c7aaf66730d6'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.088621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] The token cache is being invalidate because project 35b0fb5356b44c4eba944a050d1214be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:45.088911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.089604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.091229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1208/2446] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:44 2022] DELETE /identity/v3/projects/35b0fb5356b44c4eba944a050d1214be => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:45.093374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] The token cache is being invalidate because project 00898d846cde44268688f0f480f234cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:45.094595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.095256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.095682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c565628c-4881-4c07-b95c-11a6410feaf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.096791 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.098694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1239/2447] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:44 2022] DELETE /identity/v3/projects/00898d846cde44268688f0f480f234cc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:45.103914 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758203-b418-44d6-823c-6aa1442422e9 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.104248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758203-b418-44d6-823c-6aa1442422e9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.104581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758203-b418-44d6-823c-6aa1442422e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.134524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-14758203-b418-44d6-823c-6aa1442422e9 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:45.136512 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-14758203-b418-44d6-823c-6aa1442422e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.165538 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177a74a-5227-4f42-bf8a-c7aaf66730d6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.212865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1240/2448] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:45.221929 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef061e85-3605-467c-8004-20dd277de685 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.222213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef061e85-3605-467c-8004-20dd277de685 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.222486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef061e85-3605-467c-8004-20dd277de685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.224430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.224928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.225213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.225489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] PATH_INFO: `/v3/users/8d99383a3a30491dbeb2948da8080eec` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.226855 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d99383a3a30491dbeb2948da8080eec)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.228801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.243812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-ef061e85-3605-467c-8004-20dd277de685 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:45.245149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ef061e85-3605-467c-8004-20dd277de685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.253895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1241/2449] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:45.258782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef061e85-3605-467c-8004-20dd277de685 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.268575 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef061e85-3605-467c-8004-20dd277de685 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.273349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882a1e8-3fd3-4b10-9917-8243806f421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.274614 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882a1e8-3fd3-4b10-9917-8243806f421c admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.274900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882a1e8-3fd3-4b10-9917-8243806f421c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.275173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882a1e8-3fd3-4b10-9917-8243806f421c admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.275890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882a1e8-3fd3-4b10-9917-8243806f421c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:45.276193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882a1e8-3fd3-4b10-9917-8243806f421c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.277814 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882a1e8-3fd3-4b10-9917-8243806f421c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.278240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d99383a3a30491dbeb2948da8080eec'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.290321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1242/2450] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:45.290725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d99383a3a30491dbeb2948da8080eec'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.294253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882a1e8-3fd3-4b10-9917-8243806f421c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.297733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d99383a3a30491dbeb2948da8080eec'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.298449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d99383a3a30491dbeb2948da8080eec'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.303781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882a1e8-3fd3-4b10-9917-8243806f421c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.307759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d99383a3a30491dbeb2948da8080eec'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.313136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f166b-1ee5-433f-a510-89ae8892c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.313836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f166b-1ee5-433f-a510-89ae8892c710 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.314115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f166b-1ee5-433f-a510-89ae8892c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.314390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f166b-1ee5-433f-a510-89ae8892c710 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.315234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f166b-1ee5-433f-a510-89ae8892c710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.315887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1209/2451] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:45 2022] DELETE /identity/v3/users/8d99383a3a30491dbeb2948da8080eec => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:45.317736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f166b-1ee5-433f-a510-89ae8892c710 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.351650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1243/2452] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:45 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:45.353463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.356283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.431932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6394dd-2abb-4c73-965b-d748aadc9c31 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.505372 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8a8ff-687b-49e2-b120-1692fc349117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.506082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a8ff-687b-49e2-b120-1692fc349117 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.506367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a8ff-687b-49e2-b120-1692fc349117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.506642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a8ff-687b-49e2-b120-1692fc349117 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.507330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8a8ff-687b-49e2-b120-1692fc349117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.510216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8a8ff-687b-49e2-b120-1692fc349117 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.530835 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1210/2453] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:45 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:45.534778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f166b-1ee5-433f-a510-89ae8892c710 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.545022 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f166b-1ee5-433f-a510-89ae8892c710 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.549580 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492266-0f2a-4fde-b34e-0bd7dbddd9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.550264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492266-0f2a-4fde-b34e-0bd7dbddd9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.550550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492266-0f2a-4fde-b34e-0bd7dbddd9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.550822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492266-0f2a-4fde-b34e-0bd7dbddd9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.551573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2492266-0f2a-4fde-b34e-0bd7dbddd9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.553160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2492266-0f2a-4fde-b34e-0bd7dbddd9f9 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.564322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1244/2454] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:45.568074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8a8ff-687b-49e2-b120-1692fc349117 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.579194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8a8ff-687b-49e2-b120-1692fc349117 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.583962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb9858-8aaa-4f00-8c6f-c2732c59f811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.584637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb9858-8aaa-4f00-8c6f-c2732c59f811 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.584926 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb9858-8aaa-4f00-8c6f-c2732c59f811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.585203 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb9858-8aaa-4f00-8c6f-c2732c59f811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.586029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb9858-8aaa-4f00-8c6f-c2732c59f811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.587631 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb9858-8aaa-4f00-8c6f-c2732c59f811 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.600758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1211/2455] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:45.602178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492266-0f2a-4fde-b34e-0bd7dbddd9f9 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.612121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492266-0f2a-4fde-b34e-0bd7dbddd9f9 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.616774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954f55-9d4e-4696-bd5d-ec28ea08ccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.618272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954f55-9d4e-4696-bd5d-ec28ea08ccb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.618559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954f55-9d4e-4696-bd5d-ec28ea08ccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.618958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954f55-9d4e-4696-bd5d-ec28ea08ccb9 admin admin] PATH_INFO: `/v3/projects/15f23005325f4540969b638d811fa364/users/549f9bf8e4f54d00bc0c99d821865ee6/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.634307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56954f55-9d4e-4696-bd5d-ec28ea08ccb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f23005325f4540969b638d811fa364, user_id=549f9bf8e4f54d00bc0c99d821865ee6, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.636955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56954f55-9d4e-4696-bd5d-ec28ea08ccb9 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.653018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1245/2456] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:45 2022] PUT /identity/v3/projects/15f23005325f4540969b638d811fa364/users/549f9bf8e4f54d00bc0c99d821865ee6/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:45.658875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750870e-605f-41cf-a88f-bc8e95eeeb66 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.659492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750870e-605f-41cf-a88f-bc8e95eeeb66 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.659842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750870e-605f-41cf-a88f-bc8e95eeeb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.664705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954f55-9d4e-4696-bd5d-ec28ea08ccb9 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.666471 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-56954f55-9d4e-4696-bd5d-ec28ea08ccb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.683308 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8750870e-605f-41cf-a88f-bc8e95eeeb66 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:45.684590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8750870e-605f-41cf-a88f-bc8e95eeeb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.736377 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954f55-9d4e-4696-bd5d-ec28ea08ccb9 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.741074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.742105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.742910 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.743186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] PATH_INFO: `/v3/projects/dc210ddc26cd4cc3b4776bd9254a05b2` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.744438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc210ddc26cd4cc3b4776bd9254a05b2)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.745684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1212/2457] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:45.746491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.756301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750870e-605f-41cf-a88f-bc8e95eeeb66 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.758254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8750870e-605f-41cf-a88f-bc8e95eeeb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.793145 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc210ddc26cd4cc3b4776bd9254a05b2', 'request_id': 'req-19993c9e-41ea-42d5-9bfb-479c65920abe'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.801154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc210ddc26cd4cc3b4776bd9254a05b2', 'request_id': 'req-19993c9e-41ea-42d5-9bfb-479c65920abe'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.807934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc210ddc26cd4cc3b4776bd9254a05b2', 'request_id': 'req-19993c9e-41ea-42d5-9bfb-479c65920abe'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.815153 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750870e-605f-41cf-a88f-bc8e95eeeb66 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.818317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] The token cache is being invalidate because project dc210ddc26cd4cc3b4776bd9254a05b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:45.818608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.819253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-19993c9e-41ea-42d5-9bfb-479c65920abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:45.821225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1246/2458] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:45 2022] DELETE /identity/v3/projects/dc210ddc26cd4cc3b4776bd9254a05b2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:45.825853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9dc55-b518-4a47-9a8b-29f746f51400 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.826143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9dc55-b518-4a47-9a8b-29f746f51400 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.826422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9dc55-b518-4a47-9a8b-29f746f51400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.843735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-81c9dc55-b518-4a47-9a8b-29f746f51400 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:45.844938 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-81c9dc55-b518-4a47-9a8b-29f746f51400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.863726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f37921-1218-43cf-95c6-8a3b4fc749a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.864375 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f37921-1218-43cf-95c6-8a3b4fc749a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.864655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f37921-1218-43cf-95c6-8a3b4fc749a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.864928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f37921-1218-43cf-95c6-8a3b4fc749a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.866745 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-39f37921-1218-43cf-95c6-8a3b4fc749a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.903180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1247/2459] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:45.910987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe6a1-eddb-4881-9162-f90d7dfa0dc2 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.911276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe6a1-eddb-4881-9162-f90d7dfa0dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.911553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe6a1-eddb-4881-9162-f90d7dfa0dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.928747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f37921-1218-43cf-95c6-8a3b4fc749a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.929115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-fe3fe6a1-eddb-4881-9162-f90d7dfa0dc2 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:45.930848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f37921-1218-43cf-95c6-8a3b4fc749a6 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.931015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fe3fe6a1-eddb-4881-9162-f90d7dfa0dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:45.938926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1248/2460] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:45.940673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1213/2461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:45.942855 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fe6a1-eddb-4881-9162-f90d7dfa0dc2 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.951858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fe6a1-eddb-4881-9162-f90d7dfa0dc2 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.956666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62389-2f14-4369-a0a7-e4b5e50a8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.957562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62389-2f14-4369-a0a7-e4b5e50a8a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.957970 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62389-2f14-4369-a0a7-e4b5e50a8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.958693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62389-2f14-4369-a0a7-e4b5e50a8a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.959525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62389-2f14-4369-a0a7-e4b5e50a8a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:45.960030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62389-2f14-4369-a0a7-e4b5e50a8a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.961844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62389-2f14-4369-a0a7-e4b5e50a8a6c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:45.978972 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1249/2462] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:45.980130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f37921-1218-43cf-95c6-8a3b4fc749a6 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:45.989548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f37921-1218-43cf-95c6-8a3b4fc749a6 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:45.994688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0ed92-7139-4609-9537-959dd75b60cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:45.995333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0ed92-7139-4609-9537-959dd75b60cb admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:45.995613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0ed92-7139-4609-9537-959dd75b60cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:45.995889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0ed92-7139-4609-9537-959dd75b60cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:45.996602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0ed92-7139-4609-9537-959dd75b60cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:45.998524 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0ed92-7139-4609-9537-959dd75b60cb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.029557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1214/2463] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:45 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:46.034286 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62389-2f14-4369-a0a7-e4b5e50a8a6c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.046099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62389-2f14-4369-a0a7-e4b5e50a8a6c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.103721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde4e3a-5613-4cf3-81a1-019bfbaaf5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.104427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde4e3a-5613-4cf3-81a1-019bfbaaf5ad admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.104705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde4e3a-5613-4cf3-81a1-019bfbaaf5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.104981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde4e3a-5613-4cf3-81a1-019bfbaaf5ad admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.106197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde4e3a-5613-4cf3-81a1-019bfbaaf5ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.108137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde4e3a-5613-4cf3-81a1-019bfbaaf5ad admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.129904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1250/2464] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:46 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:46.133927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0ed92-7139-4609-9537-959dd75b60cb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.144943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0ed92-7139-4609-9537-959dd75b60cb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.152595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcc22f-7444-4f09-b382-84612f2eeb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.153288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcc22f-7444-4f09-b382-84612f2eeb19 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.153594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcc22f-7444-4f09-b382-84612f2eeb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.153875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcc22f-7444-4f09-b382-84612f2eeb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.154603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcc22f-7444-4f09-b382-84612f2eeb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.156497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcc22f-7444-4f09-b382-84612f2eeb19 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.173599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1215/2465] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:46.174870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde4e3a-5613-4cf3-81a1-019bfbaaf5ad admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.185517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde4e3a-5613-4cf3-81a1-019bfbaaf5ad admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.191151 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34f64-6162-474e-a8cd-4465a20ac136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.192066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34f64-6162-474e-a8cd-4465a20ac136 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.192066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34f64-6162-474e-a8cd-4465a20ac136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.192357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34f64-6162-474e-a8cd-4465a20ac136 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.193082 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c34f64-6162-474e-a8cd-4465a20ac136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.194722 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c34f64-6162-474e-a8cd-4465a20ac136 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.207897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1251/2466] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:46.212024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcc22f-7444-4f09-b382-84612f2eeb19 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.222955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcc22f-7444-4f09-b382-84612f2eeb19 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.227899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dbbf0-7416-489b-8d80-a8961ed14ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.228785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dbbf0-7416-489b-8d80-a8961ed14ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.229069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dbbf0-7416-489b-8d80-a8961ed14ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.229352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dbbf0-7416-489b-8d80-a8961ed14ea7 admin admin] PATH_INFO: `/v3/projects/c1b707cdf7c14eee8e441e9186272233/users/3a82fd4a67da452cbe3b3284fdf83ded/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.244842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5dbbf0-7416-489b-8d80-a8961ed14ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b707cdf7c14eee8e441e9186272233, user_id=3a82fd4a67da452cbe3b3284fdf83ded, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.247770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5dbbf0-7416-489b-8d80-a8961ed14ea7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.262771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1216/2467] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:46 2022] PUT /identity/v3/projects/c1b707cdf7c14eee8e441e9186272233/users/3a82fd4a67da452cbe3b3284fdf83ded/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:46.274012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa30a-609d-4c85-a1f2-d78783529ff3 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.274559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa30a-609d-4c85-a1f2-d78783529ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.274559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa30a-609d-4c85-a1f2-d78783529ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.311182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f1faa30a-609d-4c85-a1f2-d78783529ff3 None None] MFA Rules not processed for user `3a82fd4a67da452cbe3b3284fdf83ded`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:46.312318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f1faa30a-609d-4c85-a1f2-d78783529ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:46.392768 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1252/2468] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:46.399347 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dbbf0-7416-489b-8d80-a8961ed14ea7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.463457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dbbf0-7416-489b-8d80-a8961ed14ea7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.468559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa7294-7c77-4c39-98d1-c5631b83bad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.469212 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa7294-7c77-4c39-98d1-c5631b83bad2 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.469660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa7294-7c77-4c39-98d1-c5631b83bad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.469938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa7294-7c77-4c39-98d1-c5631b83bad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.470635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa7294-7c77-4c39-98d1-c5631b83bad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.472522 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa7294-7c77-4c39-98d1-c5631b83bad2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.498639 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1217/2469] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:46 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:46.502693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa30a-609d-4c85-a1f2-d78783529ff3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.513975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa30a-609d-4c85-a1f2-d78783529ff3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.580705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb98273-c3ee-4e34-9be5-ccbbb8d9c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.580705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb98273-c3ee-4e34-9be5-ccbbb8d9c872 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.580705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb98273-c3ee-4e34-9be5-ccbbb8d9c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.580705 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb98273-c3ee-4e34-9be5-ccbbb8d9c872 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.581121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb98273-c3ee-4e34-9be5-ccbbb8d9c872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.581121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb98273-c3ee-4e34-9be5-ccbbb8d9c872 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.583811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53fab9-849d-4b1f-9fae-ae8d3ee405e9 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.584267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53fab9-849d-4b1f-9fae-ae8d3ee405e9 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.585438 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53fab9-849d-4b1f-9fae-ae8d3ee405e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.602563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1253/2470] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:46 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:46.606683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb98273-c3ee-4e34-9be5-ccbbb8d9c872 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.623776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb98273-c3ee-4e34-9be5-ccbbb8d9c872 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.625505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0a53fab9-849d-4b1f-9fae-ae8d3ee405e9 None None] MFA Rules not processed for user `549f9bf8e4f54d00bc0c99d821865ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:46.627579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0a53fab9-849d-4b1f-9fae-ae8d3ee405e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:46.629083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b133-059e-465f-9784-cd83b6619640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.630331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b133-059e-465f-9784-cd83b6619640 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.630764 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b133-059e-465f-9784-cd83b6619640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.631090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b133-059e-465f-9784-cd83b6619640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.631932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74b133-059e-465f-9784-cd83b6619640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.633708 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74b133-059e-465f-9784-cd83b6619640 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.646335 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1254/2471] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:46.650193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b133-059e-465f-9784-cd83b6619640 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.665246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b133-059e-465f-9784-cd83b6619640 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.673956 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc278e0-d86e-4860-96a6-347a7ac72ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.674947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc278e0-d86e-4860-96a6-347a7ac72ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.675301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc278e0-d86e-4860-96a6-347a7ac72ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.675651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc278e0-d86e-4860-96a6-347a7ac72ff6 admin admin] PATH_INFO: `/v3/projects/75807ff7587a4c9f807f6b23675060e5/users/708ed6366e244486a0300c5926035145/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.693103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc278e0-d86e-4860-96a6-347a7ac72ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75807ff7587a4c9f807f6b23675060e5, user_id=708ed6366e244486a0300c5926035145, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.696224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc278e0-d86e-4860-96a6-347a7ac72ff6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.710784 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1218/2472] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:46.711854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1255/2473] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:46 2022] PUT /identity/v3/projects/75807ff7587a4c9f807f6b23675060e5/users/708ed6366e244486a0300c5926035145/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:46.716064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc278e0-d86e-4860-96a6-347a7ac72ff6 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.717314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53fab9-849d-4b1f-9fae-ae8d3ee405e9 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.718891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0a53fab9-849d-4b1f-9fae-ae8d3ee405e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:46.737129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53fab9-849d-4b1f-9fae-ae8d3ee405e9 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.798891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6aae-6a33-4842-bab0-e03bfaea056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.799729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6aae-6a33-4842-bab0-e03bfaea056e admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.800327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6aae-6a33-4842-bab0-e03bfaea056e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.800760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6aae-6a33-4842-bab0-e03bfaea056e admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.801619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6aae-6a33-4842-bab0-e03bfaea056e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.803634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6aae-6a33-4842-bab0-e03bfaea056e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.811784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc278e0-d86e-4860-96a6-347a7ac72ff6 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.816774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc98517-365f-4666-ae2e-9b1ab04a2b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.817506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc98517-365f-4666-ae2e-9b1ab04a2b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.817874 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc98517-365f-4666-ae2e-9b1ab04a2b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.818217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc98517-365f-4666-ae2e-9b1ab04a2b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.819037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc98517-365f-4666-ae2e-9b1ab04a2b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.821052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc98517-365f-4666-ae2e-9b1ab04a2b52 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.831271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1256/2475] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:46.831436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1219/2475] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:46 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:46.835252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc98517-365f-4666-ae2e-9b1ab04a2b52 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.835412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6aae-6a33-4842-bab0-e03bfaea056e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.846208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc98517-365f-4666-ae2e-9b1ab04a2b52 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.902337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6aae-6a33-4842-bab0-e03bfaea056e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:46.904272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81b783-76e2-4f9c-9186-e077f5135dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.905199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81b783-76e2-4f9c-9186-e077f5135dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.905638 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81b783-76e2-4f9c-9186-e077f5135dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.905976 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81b783-76e2-4f9c-9186-e077f5135dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.906637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81b783-76e2-4f9c-9186-e077f5135dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.907614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000b0d2-505d-494a-857c-a5bd9e680b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:46.908503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000b0d2-505d-494a-857c-a5bd9e680b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.908626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81b783-76e2-4f9c-9186-e077f5135dd6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.908794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000b0d2-505d-494a-857c-a5bd9e680b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.909074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000b0d2-505d-494a-857c-a5bd9e680b29 admin admin] PATH_INFO: `/v3/projects/75807ff7587a4c9f807f6b23675060e5/users/708ed6366e244486a0300c5926035145/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.911094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000b0d2-505d-494a-857c-a5bd9e680b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75807ff7587a4c9f807f6b23675060e5, user_id=708ed6366e244486a0300c5926035145, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:46.914936 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000b0d2-505d-494a-857c-a5bd9e680b29 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:46.927395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1220/2476] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:46 2022] PUT /identity/v3/projects/75807ff7587a4c9f807f6b23675060e5/users/708ed6366e244486a0300c5926035145/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:46.933380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1257/2477] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:46 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:46.934900 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000b0d2-505d-494a-857c-a5bd9e680b29 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:46.937394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ae9a7-554b-4a31-9295-a28e87b34bab None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:46.937842 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ae9a7-554b-4a31-9295-a28e87b34bab None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:46.938136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ae9a7-554b-4a31-9295-a28e87b34bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:46.966945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e59ae9a7-554b-4a31-9295-a28e87b34bab None None] MFA Rules not processed for user `708ed6366e244486a0300c5926035145`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:46.968334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e59ae9a7-554b-4a31-9295-a28e87b34bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:47.007390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000b0d2-505d-494a-857c-a5bd9e680b29 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:47.012472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924f24c-8945-4d9c-a412-5aee40a2e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:47.013398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924f24c-8945-4d9c-a412-5aee40a2e8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:47.013814 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924f24c-8945-4d9c-a412-5aee40a2e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:47.014187 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924f24c-8945-4d9c-a412-5aee40a2e8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:47.015086 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924f24c-8945-4d9c-a412-5aee40a2e8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:47.016793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924f24c-8945-4d9c-a412-5aee40a2e8aa admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:47.028346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1221/2478] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:05:47.032550 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924f24c-8945-4d9c-a412-5aee40a2e8aa admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:47.043721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924f24c-8945-4d9c-a412-5aee40a2e8aa admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:47.050591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1258/2479] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:47.053802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42b30b-df64-46d1-aaf6-4e5ac624014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:47.054619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b30b-df64-46d1-aaf6-4e5ac624014d admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:47.054975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b30b-df64-46d1-aaf6-4e5ac624014d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:47.055759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b30b-df64-46d1-aaf6-4e5ac624014d admin admin] PATH_INFO: `/v3/projects/8eacdd1cca3b429b88453d15e153dc92/users/abddb1291aef4ea58265f45dcb604db9/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:47.058183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ae9a7-554b-4a31-9295-a28e87b34bab None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:47.059579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e59ae9a7-554b-4a31-9295-a28e87b34bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:47.071089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42b30b-df64-46d1-aaf6-4e5ac624014d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eacdd1cca3b429b88453d15e153dc92, user_id=abddb1291aef4ea58265f45dcb604db9, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:47.074481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42b30b-df64-46d1-aaf6-4e5ac624014d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:47.093728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1222/2480] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:47 2022] PUT /identity/v3/projects/8eacdd1cca3b429b88453d15e153dc92/users/abddb1291aef4ea58265f45dcb604db9/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:47.095346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42b30b-df64-46d1-aaf6-4e5ac624014d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:47.119271 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ae9a7-554b-4a31-9295-a28e87b34bab None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:47.162459 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42b30b-df64-46d1-aaf6-4e5ac624014d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:47.168717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0643c-a1e3-4ffd-ae76-b4dd95eafc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:47.169567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0643c-a1e3-4ffd-ae76-b4dd95eafc30 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:47.169975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0643c-a1e3-4ffd-ae76-b4dd95eafc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:47.170332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0643c-a1e3-4ffd-ae76-b4dd95eafc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:47.171282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0643c-a1e3-4ffd-ae76-b4dd95eafc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:47.173169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0643c-a1e3-4ffd-ae76-b4dd95eafc30 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:47.173940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304aaab9-03a6-47ba-9a6a-5dc4364fa104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:47.174644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aaab9-03a6-47ba-9a6a-5dc4364fa104 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:47.175051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aaab9-03a6-47ba-9a6a-5dc4364fa104 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:47.175327 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aaab9-03a6-47ba-9a6a-5dc4364fa104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:47.189177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1223/2481] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:47.190569 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0643c-a1e3-4ffd-ae76-b4dd95eafc30 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:47.202689 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0643c-a1e3-4ffd-ae76-b4dd95eafc30 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:47.210089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e5179-2c5c-444a-8f69-2555c0c3a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:47.210989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5179-2c5c-444a-8f69-2555c0c3a7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:47.211275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5179-2c5c-444a-8f69-2555c0c3a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:47.211551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5179-2c5c-444a-8f69-2555c0c3a7ac admin admin] PATH_INFO: `/v3/projects/8eacdd1cca3b429b88453d15e153dc92/users/abddb1291aef4ea58265f45dcb604db9/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:47.213578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e5179-2c5c-444a-8f69-2555c0c3a7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eacdd1cca3b429b88453d15e153dc92, user_id=abddb1291aef4ea58265f45dcb604db9, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:47.216218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e5179-2c5c-444a-8f69-2555c0c3a7ac admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:47.231433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1224/2482] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:47 2022] PUT /identity/v3/projects/8eacdd1cca3b429b88453d15e153dc92/users/abddb1291aef4ea58265f45dcb604db9/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:47.247497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304aaab9-03a6-47ba-9a6a-5dc4364fa104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:47.249113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304aaab9-03a6-47ba-9a6a-5dc4364fa104 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:47.259311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1259/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:47.650133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e5179-2c5c-444a-8f69-2555c0c3a7ac admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:47.719708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e5179-2c5c-444a-8f69-2555c0c3a7ac admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:47.725829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:47.727600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:47.727898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:47.728228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] PATH_INFO: `/v3/users/3a82fd4a67da452cbe3b3284fdf83ded` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:47.729649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a82fd4a67da452cbe3b3284fdf83ded)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:47.731868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:47.778853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a82fd4a67da452cbe3b3284fdf83ded'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:47.794154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a82fd4a67da452cbe3b3284fdf83ded'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:47.800951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a82fd4a67da452cbe3b3284fdf83ded'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:47.801677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a82fd4a67da452cbe3b3284fdf83ded'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:47.809448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-12b8cad5-39c1-4ec1-8f8e-8ca7a3d81d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a82fd4a67da452cbe3b3284fdf83ded'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:47.817072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1225/2484] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:47 2022] DELETE /identity/v3/users/3a82fd4a67da452cbe3b3284fdf83ded => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:47.821300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4979a-870e-4e05-b6f0-827536780d09 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:47.821732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4979a-870e-4e05-b6f0-827536780d09 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:47.821981 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4979a-870e-4e05-b6f0-827536780d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:47.842018 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6ee4979a-870e-4e05-b6f0-827536780d09 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:47.843240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6ee4979a-870e-4e05-b6f0-827536780d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:47.893464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b1858-b1a7-43ad-b002-d11de471b253 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:47.893851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b1858-b1a7-43ad-b002-d11de471b253 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:47.894238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b1858-b1a7-43ad-b002-d11de471b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:47.923157 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1260/2485] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:47.926552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-df7b1858-b1a7-43ad-b002-d11de471b253 None None] MFA Rules not processed for user `abddb1291aef4ea58265f45dcb604db9`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:47.927898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-df7b1858-b1a7-43ad-b002-d11de471b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:47.934011 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4979a-870e-4e05-b6f0-827536780d09 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:47.935614 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6ee4979a-870e-4e05-b6f0-827536780d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:48.018523 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1226/2486] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:48.029322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4979a-870e-4e05-b6f0-827536780d09 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:48.033162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b1858-b1a7-43ad-b002-d11de471b253 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:48.034930 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-df7b1858-b1a7-43ad-b002-d11de471b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:48.035866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b220f2-8771-484c-b457-0772368d69e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:48.036678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b220f2-8771-484c-b457-0772368d69e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:48.037102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b220f2-8771-484c-b457-0772368d69e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:48.037458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b220f2-8771-484c-b457-0772368d69e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:48.062803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b220f2-8771-484c-b457-0772368d69e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:48.064249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b220f2-8771-484c-b457-0772368d69e5 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:48.074749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1261/2487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:48.097284 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b1858-b1a7-43ad-b002-d11de471b253 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:48.102724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7e666-9bca-46c4-bdc7-4f67660350a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:48.103365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7e666-9bca-46c4-bdc7-4f67660350a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:48.103673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7e666-9bca-46c4-bdc7-4f67660350a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:48.104601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7e666-9bca-46c4-bdc7-4f67660350a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:48.106446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-85e7e666-9bca-46c4-bdc7-4f67660350a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:48.168895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7e666-9bca-46c4-bdc7-4f67660350a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:48.171118 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7e666-9bca-46c4-bdc7-4f67660350a7 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:48.182854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1227/2488] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:48.620726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b220f2-8771-484c-b457-0772368d69e5 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:48.622230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-04b220f2-8771-484c-b457-0772368d69e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:48.638236 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b220f2-8771-484c-b457-0772368d69e5 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:48.643912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:48.644668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:48.644955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:48.645234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] PATH_INFO: `/v3/projects/c1b707cdf7c14eee8e441e9186272233` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:48.646483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b707cdf7c14eee8e441e9186272233)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:48.648980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:48.693995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b707cdf7c14eee8e441e9186272233', 'request_id': 'req-a235e55c-cf71-4e9a-9c08-848782e7708c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.701065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b707cdf7c14eee8e441e9186272233', 'request_id': 'req-a235e55c-cf71-4e9a-9c08-848782e7708c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.707293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b707cdf7c14eee8e441e9186272233', 'request_id': 'req-a235e55c-cf71-4e9a-9c08-848782e7708c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.717808 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] The token cache is being invalidate because project c1b707cdf7c14eee8e441e9186272233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:48.718153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.718739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.720663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1262/2489] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:48 2022] DELETE /identity/v3/projects/c1b707cdf7c14eee8e441e9186272233 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:48.724803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7e666-9bca-46c4-bdc7-4f67660350a7 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:48.736546 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7e666-9bca-46c4-bdc7-4f67660350a7 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:48.791868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:48.792737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:48.793030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:48.793303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] PATH_INFO: `/v3/users/708ed6366e244486a0300c5926035145` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:48.794529 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708ed6366e244486a0300c5926035145)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:48.796445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:48.848613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708ed6366e244486a0300c5926035145'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.860357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708ed6366e244486a0300c5926035145'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.867022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708ed6366e244486a0300c5926035145'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.867715 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708ed6366e244486a0300c5926035145'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.874519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-756c3576-d211-4a8e-b14c-2f97b9ab6272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708ed6366e244486a0300c5926035145'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:48.880980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1228/2490] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:48 2022] DELETE /identity/v3/users/708ed6366e244486a0300c5926035145 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:49.165895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:49.168608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:49.185713 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235e55c-cf71-4e9a-9c08-848782e7708c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:49.262587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:49.264462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.264462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.264462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] PATH_INFO: `/v3/projects/75807ff7587a4c9f807f6b23675060e5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.265620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=75807ff7587a4c9f807f6b23675060e5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:49.267525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:49.319119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75807ff7587a4c9f807f6b23675060e5', 'request_id': 'req-49cbda79-2905-473b-855c-dec162e9f24b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:49.329115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75807ff7587a4c9f807f6b23675060e5', 'request_id': 'req-49cbda79-2905-473b-855c-dec162e9f24b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:49.336383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75807ff7587a4c9f807f6b23675060e5', 'request_id': 'req-49cbda79-2905-473b-855c-dec162e9f24b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:49.347024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] The token cache is being invalidate because project 75807ff7587a4c9f807f6b23675060e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:49.347331 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:49.348040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-49cbda79-2905-473b-855c-dec162e9f24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:49.349723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1263/2491] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:49 2022] DELETE /identity/v3/projects/75807ff7587a4c9f807f6b23675060e5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:49.355097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0835c-a1cb-47da-a508-4cc5af7fc3c1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.355472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0835c-a1cb-47da-a508-4cc5af7fc3c1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.355825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0835c-a1cb-47da-a508-4cc5af7fc3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.374193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7fb0835c-a1cb-47da-a508-4cc5af7fc3c1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:49.375397 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7fb0835c-a1cb-47da-a508-4cc5af7fc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:49.440105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1229/2492] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:49.448673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b66e6f-a31f-4f53-962e-c2c3108076b3 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.448967 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b66e6f-a31f-4f53-962e-c2c3108076b3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.449244 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b66e6f-a31f-4f53-962e-c2c3108076b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.467255 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-04b66e6f-a31f-4f53-962e-c2c3108076b3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:49.468459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-04b66e6f-a31f-4f53-962e-c2c3108076b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:49.476958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1264/2493] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:49.480988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0835c-a1cb-47da-a508-4cc5af7fc3c1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:49.491170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0835c-a1cb-47da-a508-4cc5af7fc3c1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:49.496258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:49.496910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.497192 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.497471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.498235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:49.498548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:49.500182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:49.515157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1230/2494] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:49.516089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b66e6f-a31f-4f53-962e-c2c3108076b3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:49.525313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b66e6f-a31f-4f53-962e-c2c3108076b3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:49.530327 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83c430-c6a7-45da-9f29-c9ab0e35835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:49.530990 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83c430-c6a7-45da-9f29-c9ab0e35835e admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.531276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83c430-c6a7-45da-9f29-c9ab0e35835e admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.531931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83c430-c6a7-45da-9f29-c9ab0e35835e admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.532402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83c430-c6a7-45da-9f29-c9ab0e35835e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:49.534593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83c430-c6a7-45da-9f29-c9ab0e35835e admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:49.537178 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:49.539497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:49.561612 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1265/2495] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:49 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:49.565401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83c430-c6a7-45da-9f29-c9ab0e35835e admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:49.598834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecd448-5af6-45bc-b877-838c99d298c7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:49.624321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83c430-c6a7-45da-9f29-c9ab0e35835e admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:49.629035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78a0f6-7f09-4930-9dde-d860282d806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:49.629720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78a0f6-7f09-4930-9dde-d860282d806f admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.629998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78a0f6-7f09-4930-9dde-d860282d806f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.630269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78a0f6-7f09-4930-9dde-d860282d806f admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.630940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78a0f6-7f09-4930-9dde-d860282d806f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:49.632924 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78a0f6-7f09-4930-9dde-d860282d806f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:49.647320 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fb8a8-9631-456f-ac1d-22ed7e014432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:49.647991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fb8a8-9631-456f-ac1d-22ed7e014432 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.648270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fb8a8-9631-456f-ac1d-22ed7e014432 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.648542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fb8a8-9631-456f-ac1d-22ed7e014432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.650464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c75fb8a8-9631-456f-ac1d-22ed7e014432 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:49.654021 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1266/2496] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:49 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:49.658432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78a0f6-7f09-4930-9dde-d860282d806f admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:49.668565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78a0f6-7f09-4930-9dde-d860282d806f admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:49.673618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f7c07-23a1-406e-9f5b-91096c408e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:49.674346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f7c07-23a1-406e-9f5b-91096c408e53 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.674631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f7c07-23a1-406e-9f5b-91096c408e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.674911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f7c07-23a1-406e-9f5b-91096c408e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.675635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f7c07-23a1-406e-9f5b-91096c408e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:49.677225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f7c07-23a1-406e-9f5b-91096c408e53 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:49.689780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1267/2497] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:49.690883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f7c07-23a1-406e-9f5b-91096c408e53 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:49.700542 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f7c07-23a1-406e-9f5b-91096c408e53 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:49.705186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cefbdc-d203-42de-87ea-5ca80b7e9c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:49.705845 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cefbdc-d203-42de-87ea-5ca80b7e9c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.706126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cefbdc-d203-42de-87ea-5ca80b7e9c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.706399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cefbdc-d203-42de-87ea-5ca80b7e9c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.707110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cefbdc-d203-42de-87ea-5ca80b7e9c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:49.708677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cefbdc-d203-42de-87ea-5ca80b7e9c8b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:49.713437 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fb8a8-9631-456f-ac1d-22ed7e014432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:49.714902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fb8a8-9631-456f-ac1d-22ed7e014432 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:49.719656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1268/2498] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:05:49.723388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cefbdc-d203-42de-87ea-5ca80b7e9c8b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:49.726891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1231/2499] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:49 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:05:49.734028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cefbdc-d203-42de-87ea-5ca80b7e9c8b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:49.738765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98294be-5e91-405a-8b51-dbb0183fb664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:49.739648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98294be-5e91-405a-8b51-dbb0183fb664 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.739930 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98294be-5e91-405a-8b51-dbb0183fb664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.740205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98294be-5e91-405a-8b51-dbb0183fb664 admin admin] PATH_INFO: `/v3/projects/0e24ce53b7a545b7baa770650b41d209/users/c80422f21b9e4ae4af82ef442798f88d/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.759701 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98294be-5e91-405a-8b51-dbb0183fb664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e24ce53b7a545b7baa770650b41d209, user_id=c80422f21b9e4ae4af82ef442798f88d, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:49.764321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98294be-5e91-405a-8b51-dbb0183fb664 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:49.780170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1269/2500] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:49 2022] PUT /identity/v3/projects/0e24ce53b7a545b7baa770650b41d209/users/c80422f21b9e4ae4af82ef442798f88d/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:49.795980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d89b-b2c7-4317-a710-c01967be8862 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.796321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d89b-b2c7-4317-a710-c01967be8862 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.796811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d89b-b2c7-4317-a710-c01967be8862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.830465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-47f8d89b-b2c7-4317-a710-c01967be8862 None None] MFA Rules not processed for user `c80422f21b9e4ae4af82ef442798f88d`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:49.831664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-47f8d89b-b2c7-4317-a710-c01967be8862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:49.897519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1232/2501] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:49.902460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98294be-5e91-405a-8b51-dbb0183fb664 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:49.963707 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98294be-5e91-405a-8b51-dbb0183fb664 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:49.968184 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c3e41-801f-4286-8e1e-a770154d43db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:49.968827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c3e41-801f-4286-8e1e-a770154d43db admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:49.969104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c3e41-801f-4286-8e1e-a770154d43db admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:49.969374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c3e41-801f-4286-8e1e-a770154d43db admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:49.970112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c3e41-801f-4286-8e1e-a770154d43db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:49.971980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c3e41-801f-4286-8e1e-a770154d43db admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:49.998862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1270/2502] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:49 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:49.999922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d89b-b2c7-4317-a710-c01967be8862 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:50.010257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d89b-b2c7-4317-a710-c01967be8862 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:50.064177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6810b-6e18-4398-8fc0-4804eeae1c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:50.064844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6810b-6e18-4398-8fc0-4804eeae1c33 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:50.065179 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6810b-6e18-4398-8fc0-4804eeae1c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:50.065466 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6810b-6e18-4398-8fc0-4804eeae1c33 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:50.066258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6810b-6e18-4398-8fc0-4804eeae1c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:50.068214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6810b-6e18-4398-8fc0-4804eeae1c33 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:50.092720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1233/2503] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:49 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:50.094284 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c3e41-801f-4286-8e1e-a770154d43db admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:50.106579 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c3e41-801f-4286-8e1e-a770154d43db admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:50.111544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a7c7d-91d2-4b5f-b00c-e2cc5f06e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:50.112261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a7c7d-91d2-4b5f-b00c-e2cc5f06e645 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:50.112612 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a7c7d-91d2-4b5f-b00c-e2cc5f06e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:50.112890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a7c7d-91d2-4b5f-b00c-e2cc5f06e645 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:50.113642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a7c7d-91d2-4b5f-b00c-e2cc5f06e645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:50.115255 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a7c7d-91d2-4b5f-b00c-e2cc5f06e645 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:50.130188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1271/2504] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:50.131421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6810b-6e18-4398-8fc0-4804eeae1c33 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:50.142353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6810b-6e18-4398-8fc0-4804eeae1c33 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:50.147158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97386b8-d572-4b44-bc3d-112b4fb9f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:50.148059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97386b8-d572-4b44-bc3d-112b4fb9f5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:50.148351 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97386b8-d572-4b44-bc3d-112b4fb9f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:50.148780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97386b8-d572-4b44-bc3d-112b4fb9f5c0 admin admin] PATH_INFO: `/v3/projects/06c516ad79e24d94958b635fd9dccfc0/users/a15395cb8b81479089d27ecaed467c37/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:50.165021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97386b8-d572-4b44-bc3d-112b4fb9f5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c516ad79e24d94958b635fd9dccfc0, user_id=a15395cb8b81479089d27ecaed467c37, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:50.168127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97386b8-d572-4b44-bc3d-112b4fb9f5c0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:50.181054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1234/2505] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:50 2022] PUT /identity/v3/projects/06c516ad79e24d94958b635fd9dccfc0/users/a15395cb8b81479089d27ecaed467c37/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:50.184925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a7c7d-91d2-4b5f-b00c-e2cc5f06e645 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:50.195715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a7c7d-91d2-4b5f-b00c-e2cc5f06e645 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:50.251454 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0268d7-50fe-4ad2-8c8b-50d2e5bc0d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:50.252033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0268d7-50fe-4ad2-8c8b-50d2e5bc0d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:50.252317 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0268d7-50fe-4ad2-8c8b-50d2e5bc0d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:50.252596 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0268d7-50fe-4ad2-8c8b-50d2e5bc0d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:50.253311 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0268d7-50fe-4ad2-8c8b-50d2e5bc0d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:50.254949 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0268d7-50fe-4ad2-8c8b-50d2e5bc0d3c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:50.264594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1272/2506] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:05:50.268591 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97386b8-d572-4b44-bc3d-112b4fb9f5c0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:50.279127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97386b8-d572-4b44-bc3d-112b4fb9f5c0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:50.284234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3825a4-5941-4f15-94a4-7df7348edc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:50.285122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3825a4-5941-4f15-94a4-7df7348edc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:50.285408 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3825a4-5941-4f15-94a4-7df7348edc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:50.285724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3825a4-5941-4f15-94a4-7df7348edc42 admin admin] PATH_INFO: `/v3/projects/06c516ad79e24d94958b635fd9dccfc0/users/a15395cb8b81479089d27ecaed467c37/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:50.287707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3825a4-5941-4f15-94a4-7df7348edc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c516ad79e24d94958b635fd9dccfc0, user_id=a15395cb8b81479089d27ecaed467c37, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:50.290947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3825a4-5941-4f15-94a4-7df7348edc42 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:50.302590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1235/2507] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:50 2022] PUT /identity/v3/projects/06c516ad79e24d94958b635fd9dccfc0/users/a15395cb8b81479089d27ecaed467c37/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:50.313433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15430-d962-495a-8303-4f7786012734 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:50.313765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15430-d962-495a-8303-4f7786012734 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:50.314075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15430-d962-495a-8303-4f7786012734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:50.341941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e4b15430-d962-495a-8303-4f7786012734 None None] MFA Rules not processed for user `a15395cb8b81479089d27ecaed467c37`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:50.343166 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e4b15430-d962-495a-8303-4f7786012734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:50.409610 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1273/2508] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:50.420672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3825a4-5941-4f15-94a4-7df7348edc42 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:50.476892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3825a4-5941-4f15-94a4-7df7348edc42 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:50.480461 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bc1f4-b18f-48d7-9189-fa2087caef86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:50.481096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bc1f4-b18f-48d7-9189-fa2087caef86 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:50.481377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bc1f4-b18f-48d7-9189-fa2087caef86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:50.481687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bc1f4-b18f-48d7-9189-fa2087caef86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:50.490776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bc1f4-b18f-48d7-9189-fa2087caef86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:50.492935 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bc1f4-b18f-48d7-9189-fa2087caef86 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:50.502467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1236/2509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:51.811029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15430-d962-495a-8303-4f7786012734 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:51.872353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15430-d962-495a-8303-4f7786012734 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:51.877203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:51.878173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:51.878451 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:51.878724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] PATH_INFO: `/v3/users/c80422f21b9e4ae4af82ef442798f88d` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:51.880068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80422f21b9e4ae4af82ef442798f88d)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:51.882055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:51.927383 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80422f21b9e4ae4af82ef442798f88d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:51.928031 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80422f21b9e4ae4af82ef442798f88d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:51.940016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80422f21b9e4ae4af82ef442798f88d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:51.940667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80422f21b9e4ae4af82ef442798f88d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:51.947625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80422f21b9e4ae4af82ef442798f88d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:51.959340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1274/2510] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:51 2022] DELETE /identity/v3/users/c80422f21b9e4ae4af82ef442798f88d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:51.964229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667365-f515-4eb0-aeef-975cb7a63b63 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:51.964919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667365-f515-4eb0-aeef-975cb7a63b63 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:51.964919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667365-f515-4eb0-aeef-975cb7a63b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:51.983880 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-37667365-f515-4eb0-aeef-975cb7a63b63 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:51.985087 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-37667365-f515-4eb0-aeef-975cb7a63b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:52.047297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1237/2511] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:52.053759 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:52.055783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:52.111812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b65e-cca4-4815-bade-e61ec374bc76 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:52.115540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299f61-793c-457a-bdd9-009db60b617c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:52.116186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299f61-793c-457a-bdd9-009db60b617c service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:52.116468 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299f61-793c-457a-bdd9-009db60b617c service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:52.117261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299f61-793c-457a-bdd9-009db60b617c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:52.126561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c299f61-793c-457a-bdd9-009db60b617c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:52.128012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c299f61-793c-457a-bdd9-009db60b617c service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:52.143943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1275/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:52.455432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667365-f515-4eb0-aeef-975cb7a63b63 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:52.456986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-37667365-f515-4eb0-aeef-975cb7a63b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:52.472938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667365-f515-4eb0-aeef-975cb7a63b63 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:52.480498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:52.482270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:52.486130 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:52.486672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] PATH_INFO: `/v3/projects/0e24ce53b7a545b7baa770650b41d209` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:52.488795 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e24ce53b7a545b7baa770650b41d209)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:52.491283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:52.547568 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e24ce53b7a545b7baa770650b41d209', 'request_id': 'req-20cdf538-29ea-4e54-b207-1dca5811e9ba'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.555171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e24ce53b7a545b7baa770650b41d209', 'request_id': 'req-20cdf538-29ea-4e54-b207-1dca5811e9ba'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.561420 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e24ce53b7a545b7baa770650b41d209', 'request_id': 'req-20cdf538-29ea-4e54-b207-1dca5811e9ba'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.575826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] The token cache is being invalidate because project 0e24ce53b7a545b7baa770650b41d209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:52.575826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.576573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.578288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1238/2513] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:52 2022] DELETE /identity/v3/projects/0e24ce53b7a545b7baa770650b41d209 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:52.582497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299f61-793c-457a-bdd9-009db60b617c service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:52.593663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299f61-793c-457a-bdd9-009db60b617c service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:52.655732 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:52.656804 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:52.657114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:52.657466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] PATH_INFO: `/v3/users/a15395cb8b81479089d27ecaed467c37` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:52.658801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15395cb8b81479089d27ecaed467c37)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:52.660849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:52.720841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15395cb8b81479089d27ecaed467c37'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.721588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15395cb8b81479089d27ecaed467c37'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.734871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15395cb8b81479089d27ecaed467c37'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.735626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15395cb8b81479089d27ecaed467c37'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.743816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-22e7b143-4390-493d-8ac1-4cf19249c837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15395cb8b81479089d27ecaed467c37'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:52.764326 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1276/2514] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:05:52 2022] DELETE /identity/v3/users/a15395cb8b81479089d27ecaed467c37 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:53.054670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.056149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:53.069844 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdf538-29ea-4e54-b207-1dca5811e9ba admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.124256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.125139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.125555 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.125852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] PATH_INFO: `/v3/projects/06c516ad79e24d94958b635fd9dccfc0` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.127098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c516ad79e24d94958b635fd9dccfc0)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.129007 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.174863 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c516ad79e24d94958b635fd9dccfc0', 'request_id': 'req-de677291-880b-47d9-914c-78aec4250065'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:53.183120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c516ad79e24d94958b635fd9dccfc0', 'request_id': 'req-de677291-880b-47d9-914c-78aec4250065'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:53.188748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c516ad79e24d94958b635fd9dccfc0', 'request_id': 'req-de677291-880b-47d9-914c-78aec4250065'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:53.199925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] The token cache is being invalidate because project 06c516ad79e24d94958b635fd9dccfc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:05:53.200226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:53.200840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-de677291-880b-47d9-914c-78aec4250065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:05:53.202405 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1239/2515] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:05:53 2022] DELETE /identity/v3/projects/06c516ad79e24d94958b635fd9dccfc0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:53.207706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1655b4-0219-4c76-97c8-69628a828db1 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.208176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1655b4-0219-4c76-97c8-69628a828db1 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.208274 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1655b4-0219-4c76-97c8-69628a828db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.224973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-2a1655b4-0219-4c76-97c8-69628a828db1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:53.226720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2a1655b4-0219-4c76-97c8-69628a828db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:53.282364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1277/2516] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:53.291904 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c391-8f5e-4ed7-b195-5071afe24bbe None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.292200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c391-8f5e-4ed7-b195-5071afe24bbe None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.292480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c391-8f5e-4ed7-b195-5071afe24bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.312493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-21c9c391-8f5e-4ed7-b195-5071afe24bbe None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:53.313655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-21c9c391-8f5e-4ed7-b195-5071afe24bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:53.321579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1240/2517] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:53.325728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1655b4-0219-4c76-97c8-69628a828db1 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.335134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1655b4-0219-4c76-97c8-69628a828db1 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.339678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905456f-33c7-413c-bf04-4ce829b39fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.340325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905456f-33c7-413c-bf04-4ce829b39fcb admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.340608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905456f-33c7-413c-bf04-4ce829b39fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.340884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905456f-33c7-413c-bf04-4ce829b39fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.341628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905456f-33c7-413c-bf04-4ce829b39fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:05:53.341940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905456f-33c7-413c-bf04-4ce829b39fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.343537 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905456f-33c7-413c-bf04-4ce829b39fcb admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.355152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1278/2518] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:05:53.359312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c391-8f5e-4ed7-b195-5071afe24bbe None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.369401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c391-8f5e-4ed7-b195-5071afe24bbe None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.374312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05e7d4-8508-4dc4-85e7-5031b1a3a7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.375038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e7d4-8508-4dc4-85e7-5031b1a3a7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.375386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e7d4-8508-4dc4-85e7-5031b1a3a7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.375726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e7d4-8508-4dc4-85e7-5031b1a3a7c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.376424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05e7d4-8508-4dc4-85e7-5031b1a3a7c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.378337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05e7d4-8508-4dc4-85e7-5031b1a3a7c2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.406813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1241/2519] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:53 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:05:53.407992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905456f-33c7-413c-bf04-4ce829b39fcb admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.418557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905456f-33c7-413c-bf04-4ce829b39fcb admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.472651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b5bdc-c3f3-4f8b-8f8e-dc7802c5bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.473315 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b5bdc-c3f3-4f8b-8f8e-dc7802c5bc35 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.473627 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b5bdc-c3f3-4f8b-8f8e-dc7802c5bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.473922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b5bdc-c3f3-4f8b-8f8e-dc7802c5bc35 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.474599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b5bdc-c3f3-4f8b-8f8e-dc7802c5bc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.477070 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b5bdc-c3f3-4f8b-8f8e-dc7802c5bc35 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.497835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1279/2520] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:53 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:53.501987 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05e7d4-8508-4dc4-85e7-5031b1a3a7c2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.512948 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05e7d4-8508-4dc4-85e7-5031b1a3a7c2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.517595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6327-ec57-480a-8f19-153cb588dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.518258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6327-ec57-480a-8f19-153cb588dd5d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.518535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6327-ec57-480a-8f19-153cb588dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.519017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6327-ec57-480a-8f19-153cb588dd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.519740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6327-ec57-480a-8f19-153cb588dd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.521317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6327-ec57-480a-8f19-153cb588dd5d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.531947 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1242/2521] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:53.535902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b5bdc-c3f3-4f8b-8f8e-dc7802c5bc35 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.546228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b5bdc-c3f3-4f8b-8f8e-dc7802c5bc35 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.550897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95c104-8d6e-4c69-bee4-4b9823508975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.551550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c104-8d6e-4c69-bee4-4b9823508975 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.551835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c104-8d6e-4c69-bee4-4b9823508975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.552110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c104-8d6e-4c69-bee4-4b9823508975 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.552833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95c104-8d6e-4c69-bee4-4b9823508975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.554535 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95c104-8d6e-4c69-bee4-4b9823508975 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.566615 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1280/2522] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:53.573053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6327-ec57-480a-8f19-153cb588dd5d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.583273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6327-ec57-480a-8f19-153cb588dd5d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.588891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1eaaa-d67c-43ba-bd35-374c3a169d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.589796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1eaaa-d67c-43ba-bd35-374c3a169d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.590076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1eaaa-d67c-43ba-bd35-374c3a169d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.590350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1eaaa-d67c-43ba-bd35-374c3a169d50 admin admin] PATH_INFO: `/v3/projects/3e668bad253d4180a4c13a567e4f1b89/users/2db3fd1cb40d4bce8245b9119b64eace/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.605264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1eaaa-d67c-43ba-bd35-374c3a169d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e668bad253d4180a4c13a567e4f1b89, user_id=2db3fd1cb40d4bce8245b9119b64eace, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.607951 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1eaaa-d67c-43ba-bd35-374c3a169d50 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.621502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1243/2523] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:53 2022] PUT /identity/v3/projects/3e668bad253d4180a4c13a567e4f1b89/users/2db3fd1cb40d4bce8245b9119b64eace/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:05:53.631851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff7279-8dfb-4c7f-815a-8f3adafb2049 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.632207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff7279-8dfb-4c7f-815a-8f3adafb2049 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.632974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff7279-8dfb-4c7f-815a-8f3adafb2049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.658765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-a6ff7279-8dfb-4c7f-815a-8f3adafb2049 None None] MFA Rules not processed for user `2db3fd1cb40d4bce8245b9119b64eace`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:53.659965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a6ff7279-8dfb-4c7f-815a-8f3adafb2049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:53.727715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1281/2524] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:05:53.732011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1eaaa-d67c-43ba-bd35-374c3a169d50 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.799470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1eaaa-d67c-43ba-bd35-374c3a169d50 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.805225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca40df5-60e0-4ecb-b64f-0002e844e4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.806093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40df5-60e0-4ecb-b64f-0002e844e4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.806379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40df5-60e0-4ecb-b64f-0002e844e4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.806659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40df5-60e0-4ecb-b64f-0002e844e4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.807545 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca40df5-60e0-4ecb-b64f-0002e844e4e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.811933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca40df5-60e0-4ecb-b64f-0002e844e4e0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.843114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1244/2525] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:05:53 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:53.844305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff7279-8dfb-4c7f-815a-8f3adafb2049 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.856014 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff7279-8dfb-4c7f-815a-8f3adafb2049 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.914266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf7329-0967-4a9a-a95d-e4658e0f3529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.915476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf7329-0967-4a9a-a95d-e4658e0f3529 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.915757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf7329-0967-4a9a-a95d-e4658e0f3529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.916029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf7329-0967-4a9a-a95d-e4658e0f3529 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.916711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf7329-0967-4a9a-a95d-e4658e0f3529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.918644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf7329-0967-4a9a-a95d-e4658e0f3529 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.941940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1282/2526] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:05:53 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:05:53.943357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca40df5-60e0-4ecb-b64f-0002e844e4e0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.960985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca40df5-60e0-4ecb-b64f-0002e844e4e0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:53.967220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a45691-6ae7-4af8-a14f-24ea0c74a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:53.968175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a45691-6ae7-4af8-a14f-24ea0c74a2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:53.968175 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a45691-6ae7-4af8-a14f-24ea0c74a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:53.968429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a45691-6ae7-4af8-a14f-24ea0c74a2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:53.969833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a45691-6ae7-4af8-a14f-24ea0c74a2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:53.971435 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a45691-6ae7-4af8-a14f-24ea0c74a2d1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:53.982934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1245/2527] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:53.987190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf7329-0967-4a9a-a95d-e4658e0f3529 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:53.997118 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf7329-0967-4a9a-a95d-e4658e0f3529 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:54.001912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d10c2-2a0e-408f-b8ef-c1e9c01d2368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:54.002871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d10c2-2a0e-408f-b8ef-c1e9c01d2368 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:54.003218 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d10c2-2a0e-408f-b8ef-c1e9c01d2368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:54.003557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d10c2-2a0e-408f-b8ef-c1e9c01d2368 admin admin] PATH_INFO: `/v3/projects/35bd06e445a94320a66ae275b57c5d85/users/4e8f4bd52e574b6d9e889c0eae702636/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:54.021291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d10c2-2a0e-408f-b8ef-c1e9c01d2368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bd06e445a94320a66ae275b57c5d85, user_id=4e8f4bd52e574b6d9e889c0eae702636, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:54.024749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d10c2-2a0e-408f-b8ef-c1e9c01d2368 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:54.038965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1283/2528] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:53 2022] PUT /identity/v3/projects/35bd06e445a94320a66ae275b57c5d85/users/4e8f4bd52e574b6d9e889c0eae702636/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:54.044072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a45691-6ae7-4af8-a14f-24ea0c74a2d1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:54.053741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a45691-6ae7-4af8-a14f-24ea0c74a2d1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:54.109149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9505a29-d90f-4653-8118-d7b7c647bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:54.109866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9505a29-d90f-4653-8118-d7b7c647bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:54.110032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9505a29-d90f-4653-8118-d7b7c647bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:54.110305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9505a29-d90f-4653-8118-d7b7c647bff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:54.111023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9505a29-d90f-4653-8118-d7b7c647bff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:54.112601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9505a29-d90f-4653-8118-d7b7c647bff4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:54.122248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1246/2529] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:05:54.126310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d10c2-2a0e-408f-b8ef-c1e9c01d2368 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:54.136941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d10c2-2a0e-408f-b8ef-c1e9c01d2368 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:54.141518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b039e-84e4-428a-a891-996698301621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:54.142423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b039e-84e4-428a-a891-996698301621 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:54.142702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b039e-84e4-428a-a891-996698301621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:54.142975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b039e-84e4-428a-a891-996698301621 admin admin] PATH_INFO: `/v3/projects/35bd06e445a94320a66ae275b57c5d85/users/4e8f4bd52e574b6d9e889c0eae702636/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:54.144912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b039e-84e4-428a-a891-996698301621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bd06e445a94320a66ae275b57c5d85, user_id=4e8f4bd52e574b6d9e889c0eae702636, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:54.147536 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b039e-84e4-428a-a891-996698301621 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:54.158946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1284/2530] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:05:54 2022] PUT /identity/v3/projects/35bd06e445a94320a66ae275b57c5d85/users/4e8f4bd52e574b6d9e889c0eae702636/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:05:54.169632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a2207-a4bb-4b13-b392-b82eabe2bc70 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:54.170004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a2207-a4bb-4b13-b392-b82eabe2bc70 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:54.170464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a2207-a4bb-4b13-b392-b82eabe2bc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:54.197873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-022a2207-a4bb-4b13-b392-b82eabe2bc70 None None] MFA Rules not processed for user `4e8f4bd52e574b6d9e889c0eae702636`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:05:54.199065 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-022a2207-a4bb-4b13-b392-b82eabe2bc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:54.269270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1247/2531] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:05:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:05:54.281228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b039e-84e4-428a-a891-996698301621 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:54.283090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ce8b039e-84e4-428a-a891-996698301621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:54.338144 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b039e-84e4-428a-a891-996698301621 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:54.343403 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4b2b1-d132-4525-9c8c-be667b2a6586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:54.344056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4b2b1-d132-4525-9c8c-be667b2a6586 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:54.344457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4b2b1-d132-4525-9c8c-be667b2a6586 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:54.344740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4b2b1-d132-4525-9c8c-be667b2a6586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:54.402015 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4b2b1-d132-4525-9c8c-be667b2a6586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:54.403374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4b2b1-d132-4525-9c8c-be667b2a6586 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:54.412183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1285/2532] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:05:59.071623 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a2207-a4bb-4b13-b392-b82eabe2bc70 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:05:59.073510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-022a2207-a4bb-4b13-b392-b82eabe2bc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:05:59.086711 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a2207-a4bb-4b13-b392-b82eabe2bc70 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:05:59.090674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc1618-b973-4663-961f-f0716ae562fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:05:59.091216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc1618-b973-4663-961f-f0716ae562fe service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:05:59.091456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc1618-b973-4663-961f-f0716ae562fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:05:59.091669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc1618-b973-4663-961f-f0716ae562fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:05:59.102257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc1618-b973-4663-961f-f0716ae562fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:05:59.103719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc1618-b973-4663-961f-f0716ae562fe service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:05:59.114255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1248/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:05:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:05.941267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475358-6432-42a2-abb4-bb4e3ca719f7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:05.941879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475358-6432-42a2-abb4-bb4e3ca719f7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:05.941879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475358-6432-42a2-abb4-bb4e3ca719f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:05.959964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-73475358-6432-42a2-abb4-bb4e3ca719f7 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:05.961175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-73475358-6432-42a2-abb4-bb4e3ca719f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:06.022625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1286/2534] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 19:06:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:06.050651 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc1618-b973-4663-961f-f0716ae562fe service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:06.053873 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-eadc1618-b973-4663-961f-f0716ae562fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:06.129626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc1618-b973-4663-961f-f0716ae562fe service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:06.135030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa17b-0049-49b1-ac55-9eacdafdbbd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:06.135708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa17b-0049-49b1-ac55-9eacdafdbbd6 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:06.135991 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa17b-0049-49b1-ac55-9eacdafdbbd6 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:06.136267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa17b-0049-49b1-ac55-9eacdafdbbd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:06.145352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa17b-0049-49b1-ac55-9eacdafdbbd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:06.147004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa17b-0049-49b1-ac55-9eacdafdbbd6 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:06.156971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1249/2535] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:06:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:06:07.266816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475358-6432-42a2-abb4-bb4e3ca719f7 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:07.268225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-73475358-6432-42a2-abb4-bb4e3ca719f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:07.329321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475358-6432-42a2-abb4-bb4e3ca719f7 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:07.332988 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920aed4-c9e4-4e95-875a-8c793487eb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:07.333748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920aed4-c9e4-4e95-875a-8c793487eb00 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:07.334033 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920aed4-c9e4-4e95-875a-8c793487eb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:07.334828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920aed4-c9e4-4e95-875a-8c793487eb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:07.336622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0920aed4-c9e4-4e95-875a-8c793487eb00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:07.407962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920aed4-c9e4-4e95-875a-8c793487eb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:07.409611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920aed4-c9e4-4e95-875a-8c793487eb00 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:07.423459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1287/2536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:11.081992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa17b-0049-49b1-ac55-9eacdafdbbd6 service swift] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:11.083478 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-834aa17b-0049-49b1-ac55-9eacdafdbbd6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:11.112928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa17b-0049-49b1-ac55-9eacdafdbbd6 service swift] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:11.124070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:11.125217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:11.125721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:11.126151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] PATH_INFO: `/v3/users/803b29a8c5e34ef0993913c0b08ccfd1` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:11.127545 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803b29a8c5e34ef0993913c0b08ccfd1)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:11.131217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:11.203271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803b29a8c5e34ef0993913c0b08ccfd1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.227660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803b29a8c5e34ef0993913c0b08ccfd1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.239231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803b29a8c5e34ef0993913c0b08ccfd1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.240306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803b29a8c5e34ef0993913c0b08ccfd1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.249414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-c06214f5-f597-4216-a741-0e6e4790f658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803b29a8c5e34ef0993913c0b08ccfd1'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.262752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1250/2537] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:11 2022] DELETE /identity/v3/users/803b29a8c5e34ef0993913c0b08ccfd1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:11.561692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920aed4-c9e4-4e95-875a-8c793487eb00 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:11.580687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920aed4-c9e4-4e95-875a-8c793487eb00 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:11.673161 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:11.674085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:11.674418 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:11.674702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] PATH_INFO: `/v3/projects/2a8b3b5b2c48416c8c6b99b27cfa3aeb` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:11.677677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8b3b5b2c48416c8c6b99b27cfa3aeb)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:11.680568 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:11.749842 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'request_id': 'req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.759555 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'request_id': 'req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.767529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'request_id': 'req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.786671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] The token cache is being invalidate because project 2a8b3b5b2c48416c8c6b99b27cfa3aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:11.787133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.788071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c68b7da7-aae9-4f0b-ae09-c65b2b29c952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:11.790076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1288/2538] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:11 2022] DELETE /identity/v3/projects/2a8b3b5b2c48416c8c6b99b27cfa3aeb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:11.795081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eaa68-35a1-4b7b-abea-5efa3a36a9a4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:11.795608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eaa68-35a1-4b7b-abea-5efa3a36a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:11.796246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eaa68-35a1-4b7b-abea-5efa3a36a9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:11.821298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1a2eaa68-35a1-4b7b-abea-5efa3a36a9a4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:11.823336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1a2eaa68-35a1-4b7b-abea-5efa3a36a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:11.914644 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1251/2539] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:11.923221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c4e13-a02c-40bb-b6a9-5bf4d62ef6c1 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:11.923428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c4e13-a02c-40bb-b6a9-5bf4d62ef6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:11.923676 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c4e13-a02c-40bb-b6a9-5bf4d62ef6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:11.944266 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-9a4c4e13-a02c-40bb-b6a9-5bf4d62ef6c1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:11.945738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9a4c4e13-a02c-40bb-b6a9-5bf4d62ef6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:11.955372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1289/2540] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:11.960598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eaa68-35a1-4b7b-abea-5efa3a36a9a4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:11.975530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eaa68-35a1-4b7b-abea-5efa3a36a9a4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:11.982531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bf134-00b4-437d-a3b4-6a78baec8cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:11.983291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bf134-00b4-437d-a3b4-6a78baec8cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:11.983649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bf134-00b4-437d-a3b4-6a78baec8cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:11.984012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bf134-00b4-437d-a3b4-6a78baec8cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:11.984978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bf134-00b4-437d-a3b4-6a78baec8cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:11.985295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bf134-00b4-437d-a3b4-6a78baec8cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:11.987147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bf134-00b4-437d-a3b4-6a78baec8cf0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:12.003156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1252/2541] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:06:12.007870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c4e13-a02c-40bb-b6a9-5bf4d62ef6c1 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:12.018798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c4e13-a02c-40bb-b6a9-5bf4d62ef6c1 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:12.024009 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20809f68-b7bf-42dc-85c5-2576ea473249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:12.024950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20809f68-b7bf-42dc-85c5-2576ea473249 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:12.025337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20809f68-b7bf-42dc-85c5-2576ea473249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:12.025754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20809f68-b7bf-42dc-85c5-2576ea473249 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:12.026820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20809f68-b7bf-42dc-85c5-2576ea473249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:12.029483 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20809f68-b7bf-42dc-85c5-2576ea473249 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:12.066872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1290/2542] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:12 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:12.069242 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bf134-00b4-437d-a3b4-6a78baec8cf0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:12.084666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bf134-00b4-437d-a3b4-6a78baec8cf0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:12.156076 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a4daf-da52-4b3d-8458-35fcaefd5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:12.156748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a4daf-da52-4b3d-8458-35fcaefd5cdb admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:12.157339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a4daf-da52-4b3d-8458-35fcaefd5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:12.157990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a4daf-da52-4b3d-8458-35fcaefd5cdb admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:12.159145 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a4daf-da52-4b3d-8458-35fcaefd5cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:12.164394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a4daf-da52-4b3d-8458-35fcaefd5cdb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:12.199384 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1253/2543] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:12 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:12.201166 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20809f68-b7bf-42dc-85c5-2576ea473249 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:12.213756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20809f68-b7bf-42dc-85c5-2576ea473249 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:12.219344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de6e81-ba53-488d-9b81-35a04b63670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:12.220169 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6e81-ba53-488d-9b81-35a04b63670c admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:12.220515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6e81-ba53-488d-9b81-35a04b63670c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:12.220950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6e81-ba53-488d-9b81-35a04b63670c admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:12.221622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de6e81-ba53-488d-9b81-35a04b63670c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:12.223519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de6e81-ba53-488d-9b81-35a04b63670c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:12.242816 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1291/2544] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:12.246786 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a4daf-da52-4b3d-8458-35fcaefd5cdb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:12.267629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a4daf-da52-4b3d-8458-35fcaefd5cdb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:12.280831 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4574f2-cf19-4f64-ad11-53cdf379be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:12.281888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4574f2-cf19-4f64-ad11-53cdf379be5a admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:12.282490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4574f2-cf19-4f64-ad11-53cdf379be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:12.282780 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4574f2-cf19-4f64-ad11-53cdf379be5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:12.283517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4574f2-cf19-4f64-ad11-53cdf379be5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:12.285169 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4574f2-cf19-4f64-ad11-53cdf379be5a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:12.296217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1254/2545] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:12.302492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de6e81-ba53-488d-9b81-35a04b63670c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:12.325199 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de6e81-ba53-488d-9b81-35a04b63670c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:12.336823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3569f20-b46a-47b8-a917-c703b727a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:12.338084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3569f20-b46a-47b8-a917-c703b727a025 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:12.338374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3569f20-b46a-47b8-a917-c703b727a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:12.338649 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3569f20-b46a-47b8-a917-c703b727a025 admin admin] PATH_INFO: `/v3/projects/071721d644d54deeb882d43b46a405ed/users/b3133ae8c63e47c5bf985b0b1465c501/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:12.363865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3569f20-b46a-47b8-a917-c703b727a025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071721d644d54deeb882d43b46a405ed, user_id=b3133ae8c63e47c5bf985b0b1465c501, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:12.367487 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3569f20-b46a-47b8-a917-c703b727a025 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:12.386414 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1292/2546] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:12 2022] PUT /identity/v3/projects/071721d644d54deeb882d43b46a405ed/users/b3133ae8c63e47c5bf985b0b1465c501/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:12.398925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d44ac-e319-49ca-97fd-e4ab0db6e85a None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:12.399213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d44ac-e319-49ca-97fd-e4ab0db6e85a None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:12.399852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d44ac-e319-49ca-97fd-e4ab0db6e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:12.440858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e26d44ac-e319-49ca-97fd-e4ab0db6e85a None None] MFA Rules not processed for user `b3133ae8c63e47c5bf985b0b1465c501`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:12.445298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e26d44ac-e319-49ca-97fd-e4ab0db6e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:12.558895 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1255/2547] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:12.564427 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3569f20-b46a-47b8-a917-c703b727a025 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:12.663950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3569f20-b46a-47b8-a917-c703b727a025 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:12.672657 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0d5fd-80ae-4202-b77f-8ea2d9c93fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:12.673480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0d5fd-80ae-4202-b77f-8ea2d9c93fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:12.674801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0d5fd-80ae-4202-b77f-8ea2d9c93fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:12.675305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0d5fd-80ae-4202-b77f-8ea2d9c93fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:12.676226 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0d5fd-80ae-4202-b77f-8ea2d9c93fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:12.680170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0d5fd-80ae-4202-b77f-8ea2d9c93fe1 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:12.740009 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1293/2548] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:12 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:12.744305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d44ac-e319-49ca-97fd-e4ab0db6e85a None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:12.767740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d44ac-e319-49ca-97fd-e4ab0db6e85a None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:12.896140 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0d5fd-80ae-4202-b77f-8ea2d9c93fe1 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:12.898149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-69e0d5fd-80ae-4202-b77f-8ea2d9c93fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:12.925476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba221fd4-373f-43f6-8b2b-bc2e6bc65750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:12.926404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba221fd4-373f-43f6-8b2b-bc2e6bc65750 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:12.927004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba221fd4-373f-43f6-8b2b-bc2e6bc65750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:12.927399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba221fd4-373f-43f6-8b2b-bc2e6bc65750 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:12.928773 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba221fd4-373f-43f6-8b2b-bc2e6bc65750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:12.935465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba221fd4-373f-43f6-8b2b-bc2e6bc65750 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:12.977362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1256/2549] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:12 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:12.982495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba221fd4-373f-43f6-8b2b-bc2e6bc65750 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:13.002669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba221fd4-373f-43f6-8b2b-bc2e6bc65750 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:13.018482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0d5fd-80ae-4202-b77f-8ea2d9c93fe1 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:13.018728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a9910-986f-487c-be57-0110f3201855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:13.019759 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a9910-986f-487c-be57-0110f3201855 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:13.020000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a9910-986f-487c-be57-0110f3201855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:13.020379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a9910-986f-487c-be57-0110f3201855 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:13.021398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a9910-986f-487c-be57-0110f3201855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:13.023755 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a9910-986f-487c-be57-0110f3201855 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:13.035099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:13.036284 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:13.036684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1257/2550] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:13.036989 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:13.037883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] PATH_INFO: `/v3/users/549f9bf8e4f54d00bc0c99d821865ee6` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:13.039117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=549f9bf8e4f54d00bc0c99d821865ee6)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:13.041923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:13.042472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a9910-986f-487c-be57-0110f3201855 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:13.055379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a9910-986f-487c-be57-0110f3201855 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:13.060755 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9154f-4e6d-4700-816c-1b76ad9ddb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:13.062134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9154f-4e6d-4700-816c-1b76ad9ddb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:13.062649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9154f-4e6d-4700-816c-1b76ad9ddb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:13.063142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9154f-4e6d-4700-816c-1b76ad9ddb43 admin admin] PATH_INFO: `/v3/projects/8bffb8916b9e46e9ba511d18d5276f3c/users/4248140bdcc2417da90c2e5ec24ac40b/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:13.080858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9154f-4e6d-4700-816c-1b76ad9ddb43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bffb8916b9e46e9ba511d18d5276f3c, user_id=4248140bdcc2417da90c2e5ec24ac40b, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:13.084940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9154f-4e6d-4700-816c-1b76ad9ddb43 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:13.103595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1258/2551] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:13 2022] PUT /identity/v3/projects/8bffb8916b9e46e9ba511d18d5276f3c/users/4248140bdcc2417da90c2e5ec24ac40b/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:13.108367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9154f-4e6d-4700-816c-1b76ad9ddb43 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:13.126621 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549f9bf8e4f54d00bc0c99d821865ee6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.127353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549f9bf8e4f54d00bc0c99d821865ee6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.150613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549f9bf8e4f54d00bc0c99d821865ee6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.151835 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549f9bf8e4f54d00bc0c99d821865ee6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.162562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549f9bf8e4f54d00bc0c99d821865ee6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.179025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1294/2552] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:12 2022] DELETE /identity/v3/users/549f9bf8e4f54d00bc0c99d821865ee6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:13.215558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9154f-4e6d-4700-816c-1b76ad9ddb43 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:13.289205 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8eae2-0bf9-485b-bb22-89e749bfa994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:13.289912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8eae2-0bf9-485b-bb22-89e749bfa994 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:13.290369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8eae2-0bf9-485b-bb22-89e749bfa994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:13.291166 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8eae2-0bf9-485b-bb22-89e749bfa994 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:13.291903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8eae2-0bf9-485b-bb22-89e749bfa994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:13.293729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8eae2-0bf9-485b-bb22-89e749bfa994 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:13.306807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1259/2553] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:06:13.311489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:13.313159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:13.333176 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a247-a432-4b64-990a-c37746761d0e admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:13.342287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe8021-13c3-4742-a38b-0c06cefe907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:13.343188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe8021-13c3-4742-a38b-0c06cefe907f admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:13.343465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe8021-13c3-4742-a38b-0c06cefe907f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:13.343756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe8021-13c3-4742-a38b-0c06cefe907f admin admin] PATH_INFO: `/v3/projects/8bffb8916b9e46e9ba511d18d5276f3c/users/4248140bdcc2417da90c2e5ec24ac40b/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:13.346684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe8021-13c3-4742-a38b-0c06cefe907f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bffb8916b9e46e9ba511d18d5276f3c, user_id=4248140bdcc2417da90c2e5ec24ac40b, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:13.350485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe8021-13c3-4742-a38b-0c06cefe907f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:13.372713 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1295/2554] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:13 2022] PUT /identity/v3/projects/8bffb8916b9e46e9ba511d18d5276f3c/users/4248140bdcc2417da90c2e5ec24ac40b/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:13.379875 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f1d00-dd02-47f8-af9a-6f775d5c4940 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:13.380629 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f1d00-dd02-47f8-af9a-6f775d5c4940 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:13.381094 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f1d00-dd02-47f8-af9a-6f775d5c4940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:13.397344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe8021-13c3-4742-a38b-0c06cefe907f admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:13.402443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9abe8021-13c3-4742-a38b-0c06cefe907f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:13.427024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9f2f1d00-dd02-47f8-af9a-6f775d5c4940 None None] MFA Rules not processed for user `4248140bdcc2417da90c2e5ec24ac40b`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:13.428985 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9f2f1d00-dd02-47f8-af9a-6f775d5c4940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:13.489204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe8021-13c3-4742-a38b-0c06cefe907f admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:13.494740 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:13.495608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:13.495880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:13.496160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] PATH_INFO: `/v3/projects/15f23005325f4540969b638d811fa364` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:13.497840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f23005325f4540969b638d811fa364)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:13.499635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:13.527823 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1260/2555] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:13.536103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f1d00-dd02-47f8-af9a-6f775d5c4940 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:13.538260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9f2f1d00-dd02-47f8-af9a-6f775d5c4940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:13.569393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f23005325f4540969b638d811fa364', 'request_id': 'req-a10f4944-0a80-4391-a313-792a924c5263'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.581302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f23005325f4540969b638d811fa364', 'request_id': 'req-a10f4944-0a80-4391-a313-792a924c5263'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.592049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f23005325f4540969b638d811fa364', 'request_id': 'req-a10f4944-0a80-4391-a313-792a924c5263'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.604902 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f1d00-dd02-47f8-af9a-6f775d5c4940 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:13.608416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] The token cache is being invalidate because project 15f23005325f4540969b638d811fa364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:13.608710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.609387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.611639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1296/2556] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:13 2022] DELETE /identity/v3/projects/15f23005325f4540969b638d811fa364 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:13.615426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:13.617262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:13.663976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75c60a-98eb-4966-83a2-98cf641f7625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:13.664648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75c60a-98eb-4966-83a2-98cf641f7625 service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:13.664960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75c60a-98eb-4966-83a2-98cf641f7625 service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:13.665218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75c60a-98eb-4966-83a2-98cf641f7625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:13.667107 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6f75c60a-98eb-4966-83a2-98cf641f7625 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:13.700441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f4944-0a80-4391-a313-792a924c5263 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:13.710405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:13.711667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:13.712005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:13.712219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] PATH_INFO: `/v3/users/abddb1291aef4ea58265f45dcb604db9` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:13.713787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abddb1291aef4ea58265f45dcb604db9)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:13.716115 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:13.744679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75c60a-98eb-4966-83a2-98cf641f7625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:13.746233 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75c60a-98eb-4966-83a2-98cf641f7625 service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:13.758288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1261/2557] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:06:13.787591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abddb1291aef4ea58265f45dcb604db9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.788569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abddb1291aef4ea58265f45dcb604db9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.807749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abddb1291aef4ea58265f45dcb604db9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.808519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abddb1291aef4ea58265f45dcb604db9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.818497 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-0d4a9351-558f-4c0e-a4d6-705b6efcf57b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abddb1291aef4ea58265f45dcb604db9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:13.835193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1297/2558] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:13 2022] DELETE /identity/v3/users/abddb1291aef4ea58265f45dcb604db9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:14.075925 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75c60a-98eb-4966-83a2-98cf641f7625 service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:14.093510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75c60a-98eb-4966-83a2-98cf641f7625 service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:14.186783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:14.187918 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.188531 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.189004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] PATH_INFO: `/v3/projects/8eacdd1cca3b429b88453d15e153dc92` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.191254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eacdd1cca3b429b88453d15e153dc92)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:14.193997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:14.248474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eacdd1cca3b429b88453d15e153dc92', 'request_id': 'req-79d08010-f149-46a7-b360-517d16478694'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.258215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eacdd1cca3b429b88453d15e153dc92', 'request_id': 'req-79d08010-f149-46a7-b360-517d16478694'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.264265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eacdd1cca3b429b88453d15e153dc92', 'request_id': 'req-79d08010-f149-46a7-b360-517d16478694'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.279074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] The token cache is being invalidate because project 8eacdd1cca3b429b88453d15e153dc92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:14.279387 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.280146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.282975 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1262/2559] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:14 2022] DELETE /identity/v3/projects/8eacdd1cca3b429b88453d15e153dc92 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:14.288906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba7dde-96d8-4f1f-8e23-63f5b398dfb3 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.289182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba7dde-96d8-4f1f-8e23-63f5b398dfb3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.289391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba7dde-96d8-4f1f-8e23-63f5b398dfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.312110 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4fba7dde-96d8-4f1f-8e23-63f5b398dfb3 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:14.313959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4fba7dde-96d8-4f1f-8e23-63f5b398dfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:14.323264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:14.325072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:14.403950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08010-f149-46a7-b360-517d16478694 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:14.409234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:14.410227 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.410660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.411036 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] PATH_INFO: `/v3/users/b3133ae8c63e47c5bf985b0b1465c501` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.419124 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1298/2560] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:14.419330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3133ae8c63e47c5bf985b0b1465c501)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:14.419330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:14.421088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316b3a4-913b-4404-9417-5cb698e54a27 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.421382 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316b3a4-913b-4404-9417-5cb698e54a27 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.421711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316b3a4-913b-4404-9417-5cb698e54a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.449457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-b316b3a4-913b-4404-9417-5cb698e54a27 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:14.453808 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b316b3a4-913b-4404-9417-5cb698e54a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:14.469196 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1299/2561] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:14.473493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316b3a4-913b-4404-9417-5cb698e54a27 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:14.488257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3133ae8c63e47c5bf985b0b1465c501'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.492297 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316b3a4-913b-4404-9417-5cb698e54a27 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:14.499447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3133ae8c63e47c5bf985b0b1465c501'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.500995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:14.502726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.503296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.503625 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.505121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:14.505462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:14.509246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:14.511877 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3133ae8c63e47c5bf985b0b1465c501'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.513829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3133ae8c63e47c5bf985b0b1465c501'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.524047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-4de6ef85-e798-47f0-ac57-a0b554cd7cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3133ae8c63e47c5bf985b0b1465c501'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:14.527693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1300/2562] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:06:14.528977 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:14.530863 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:14.539703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1263/2563] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:14 2022] DELETE /identity/v3/users/b3133ae8c63e47c5bf985b0b1465c501 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:14.543843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beab84-6d97-48b5-9a68-ebefcf683868 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.544143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beab84-6d97-48b5-9a68-ebefcf683868 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.544422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beab84-6d97-48b5-9a68-ebefcf683868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.544551 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f9c26-60cf-4d65-adbf-82bc59b3e356 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:14.565427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-e5beab84-6d97-48b5-9a68-ebefcf683868 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:14.566787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e5beab84-6d97-48b5-9a68-ebefcf683868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:14.610098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ed67-5ed9-4231-aa10-f63c279809d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:14.610768 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ed67-5ed9-4231-aa10-f63c279809d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.612761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ed67-5ed9-4231-aa10-f63c279809d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.613303 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ed67-5ed9-4231-aa10-f63c279809d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.614219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ed67-5ed9-4231-aa10-f63c279809d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:14.616520 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ed67-5ed9-4231-aa10-f63c279809d8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:14.638146 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1264/2564] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:14.648756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beab84-6d97-48b5-9a68-ebefcf683868 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:14.650295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e5beab84-6d97-48b5-9a68-ebefcf683868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:14.665065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1301/2565] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:14 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:14.670549 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ed67-5ed9-4231-aa10-f63c279809d8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:14.725301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beab84-6d97-48b5-9a68-ebefcf683868 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:14.772616 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ed67-5ed9-4231-aa10-f63c279809d8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:14.779844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c2ec-2637-4e66-bb96-6365bb07c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:14.780534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c2ec-2637-4e66-bb96-6365bb07c758 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.780827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c2ec-2637-4e66-bb96-6365bb07c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.781107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c2ec-2637-4e66-bb96-6365bb07c758 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.781836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658c2ec-2637-4e66-bb96-6365bb07c758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:14.783768 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658c2ec-2637-4e66-bb96-6365bb07c758 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:14.786301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd3c1-f382-43ae-8ba6-d42fcf88672f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:14.787000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd3c1-f382-43ae-8ba6-d42fcf88672f service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.787448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd3c1-f382-43ae-8ba6-d42fcf88672f service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.787734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd3c1-f382-43ae-8ba6-d42fcf88672f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.799565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedd3c1-f382-43ae-8ba6-d42fcf88672f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:14.801036 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedd3c1-f382-43ae-8ba6-d42fcf88672f service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:14.813600 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1265/2566] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:14.820234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1302/2567] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:14 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:14.824302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd3c1-f382-43ae-8ba6-d42fcf88672f service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:14.836974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd3c1-f382-43ae-8ba6-d42fcf88672f service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:14.842215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2628d-f7d1-4e02-83a3-24fc6a38718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:14.842833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2628d-f7d1-4e02-83a3-24fc6a38718f admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.843120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2628d-f7d1-4e02-83a3-24fc6a38718f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.843395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2628d-f7d1-4e02-83a3-24fc6a38718f admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.844122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2628d-f7d1-4e02-83a3-24fc6a38718f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:14.845764 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2628d-f7d1-4e02-83a3-24fc6a38718f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:14.856661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1266/2568] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:06:14.861548 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c2ec-2637-4e66-bb96-6365bb07c758 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:14.873871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c2ec-2637-4e66-bb96-6365bb07c758 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:14.879275 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e25ae-b901-4241-80e9-13d6d0d80997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:14.880365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e25ae-b901-4241-80e9-13d6d0d80997 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.881452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e25ae-b901-4241-80e9-13d6d0d80997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.881959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e25ae-b901-4241-80e9-13d6d0d80997 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.882906 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e25ae-b901-4241-80e9-13d6d0d80997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:14.884754 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e25ae-b901-4241-80e9-13d6d0d80997 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:14.905601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1303/2569] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:14.907386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2628d-f7d1-4e02-83a3-24fc6a38718f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:14.921632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2628d-f7d1-4e02-83a3-24fc6a38718f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:14.929350 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dee562-b1ed-416c-9d58-cfa22449f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:14.930481 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dee562-b1ed-416c-9d58-cfa22449f65e admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:14.930870 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dee562-b1ed-416c-9d58-cfa22449f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:14.934689 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dee562-b1ed-416c-9d58-cfa22449f65e admin admin] PATH_INFO: `/v3/projects/5a752f7bb3724478a8dd0f9dbb7c74d6/users/0b0e729d99ee48b6b9cb69c2f852b510/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:14.959491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dee562-b1ed-416c-9d58-cfa22449f65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a752f7bb3724478a8dd0f9dbb7c74d6, user_id=0b0e729d99ee48b6b9cb69c2f852b510, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:14.965069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dee562-b1ed-416c-9d58-cfa22449f65e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:15.014326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1267/2570] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:14 2022] PUT /identity/v3/projects/5a752f7bb3724478a8dd0f9dbb7c74d6/users/0b0e729d99ee48b6b9cb69c2f852b510/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:15.018531 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45e3e5-4d9e-4783-b560-72da3adfe596 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:15.018858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45e3e5-4d9e-4783-b560-72da3adfe596 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:15.019202 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45e3e5-4d9e-4783-b560-72da3adfe596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:15.053903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-bc45e3e5-4d9e-4783-b560-72da3adfe596 None None] MFA Rules not processed for user `0b0e729d99ee48b6b9cb69c2f852b510`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:15.055344 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bc45e3e5-4d9e-4783-b560-72da3adfe596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:15.162430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1304/2571] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:15.163891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dee562-b1ed-416c-9d58-cfa22449f65e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:15.171769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-36dee562-b1ed-416c-9d58-cfa22449f65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:15.175604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45e3e5-4d9e-4783-b560-72da3adfe596 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:15.177045 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bc45e3e5-4d9e-4783-b560-72da3adfe596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:15.300544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dee562-b1ed-416c-9d58-cfa22449f65e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:15.303698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45e3e5-4d9e-4783-b560-72da3adfe596 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:15.310809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f8976-71dc-403c-accb-59b57bff2570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:15.311711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f8976-71dc-403c-accb-59b57bff2570 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:15.312152 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f8976-71dc-403c-accb-59b57bff2570 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:15.312599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f8976-71dc-403c-accb-59b57bff2570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:15.317763 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:15.319766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:15.320204 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:15.320654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] PATH_INFO: `/v3/projects/071721d644d54deeb882d43b46a405ed` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:15.323264 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071721d644d54deeb882d43b46a405ed)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:15.331302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:15.335506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f8976-71dc-403c-accb-59b57bff2570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:15.337457 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f8976-71dc-403c-accb-59b57bff2570 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:15.359690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1305/2572] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:15.427552 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071721d644d54deeb882d43b46a405ed', 'request_id': 'req-70bbee57-35c8-4eba-bb2f-428d2f99c488'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.439572 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071721d644d54deeb882d43b46a405ed', 'request_id': 'req-70bbee57-35c8-4eba-bb2f-428d2f99c488'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.449492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071721d644d54deeb882d43b46a405ed', 'request_id': 'req-70bbee57-35c8-4eba-bb2f-428d2f99c488'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.465796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] The token cache is being invalidate because project 071721d644d54deeb882d43b46a405ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:15.468783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.470290 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.473966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1268/2573] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:15 2022] DELETE /identity/v3/projects/071721d644d54deeb882d43b46a405ed => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:15.480109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f8976-71dc-403c-accb-59b57bff2570 service cinder] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:15.495913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f8976-71dc-403c-accb-59b57bff2570 service cinder] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:15.588507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:15.589933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:15.590882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:15.591751 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] PATH_INFO: `/v3/users/4248140bdcc2417da90c2e5ec24ac40b` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:15.593711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4248140bdcc2417da90c2e5ec24ac40b)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:15.596838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:15.669493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4248140bdcc2417da90c2e5ec24ac40b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.670815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4248140bdcc2417da90c2e5ec24ac40b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.688935 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4248140bdcc2417da90c2e5ec24ac40b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.690046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4248140bdcc2417da90c2e5ec24ac40b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.701724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-066857f6-0d94-4acd-8454-5621ef4da74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4248140bdcc2417da90c2e5ec24ac40b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:15.731156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1306/2574] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:15 2022] DELETE /identity/v3/users/4248140bdcc2417da90c2e5ec24ac40b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:16.062458 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:16.063921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:16.082436 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbee57-35c8-4eba-bb2f-428d2f99c488 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:16.174520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:16.175390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.175672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.175941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] PATH_INFO: `/v3/projects/8bffb8916b9e46e9ba511d18d5276f3c` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.177402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bffb8916b9e46e9ba511d18d5276f3c)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:16.180187 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:16.257345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bffb8916b9e46e9ba511d18d5276f3c', 'request_id': 'req-50bdb4cd-2df4-4cc6-afb6-47dc17882835'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:16.271654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bffb8916b9e46e9ba511d18d5276f3c', 'request_id': 'req-50bdb4cd-2df4-4cc6-afb6-47dc17882835'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:16.286151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bffb8916b9e46e9ba511d18d5276f3c', 'request_id': 'req-50bdb4cd-2df4-4cc6-afb6-47dc17882835'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:16.306097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] The token cache is being invalidate because project 8bffb8916b9e46e9ba511d18d5276f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:16.306462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:16.307220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-50bdb4cd-2df4-4cc6-afb6-47dc17882835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:16.309633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1269/2575] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:16 2022] DELETE /identity/v3/projects/8bffb8916b9e46e9ba511d18d5276f3c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:16.315680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272d9b0-fc77-4d5e-911d-acb10dd491a1 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.316474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272d9b0-fc77-4d5e-911d-acb10dd491a1 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.316992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272d9b0-fc77-4d5e-911d-acb10dd491a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.343235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-3272d9b0-fc77-4d5e-911d-acb10dd491a1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:16.344443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3272d9b0-fc77-4d5e-911d-acb10dd491a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:16.425632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1307/2576] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:16.434905 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0810c-323b-4993-9168-69da42dde9a1 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.435226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0810c-323b-4993-9168-69da42dde9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.435512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0810c-323b-4993-9168-69da42dde9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.454723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-45a0810c-323b-4993-9168-69da42dde9a1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:16.456171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-45a0810c-323b-4993-9168-69da42dde9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:16.467977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1270/2577] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:16.472430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272d9b0-fc77-4d5e-911d-acb10dd491a1 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:16.484123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272d9b0-fc77-4d5e-911d-acb10dd491a1 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:16.489763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1be6f-9c3b-4bdd-b78d-24690b110dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:16.490499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1be6f-9c3b-4bdd-b78d-24690b110dea admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.490794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1be6f-9c3b-4bdd-b78d-24690b110dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.491030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1be6f-9c3b-4bdd-b78d-24690b110dea admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.491744 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1be6f-9c3b-4bdd-b78d-24690b110dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:16.492036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1be6f-9c3b-4bdd-b78d-24690b110dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:16.493692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1be6f-9c3b-4bdd-b78d-24690b110dea admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:16.510767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1308/2578] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:06:16.511741 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0810c-323b-4993-9168-69da42dde9a1 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:16.523807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0810c-323b-4993-9168-69da42dde9a1 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:16.528788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540f4e-5bd7-4e2f-bfc9-16abd915afb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:16.529446 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540f4e-5bd7-4e2f-bfc9-16abd915afb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.529788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540f4e-5bd7-4e2f-bfc9-16abd915afb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.530065 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540f4e-5bd7-4e2f-bfc9-16abd915afb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.530751 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6540f4e-5bd7-4e2f-bfc9-16abd915afb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:16.532673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6540f4e-5bd7-4e2f-bfc9-16abd915afb0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:16.564413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1271/2579] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:16 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:16.569250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1be6f-9c3b-4bdd-b78d-24690b110dea admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:16.585248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1be6f-9c3b-4bdd-b78d-24690b110dea admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:16.684203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1066dee-87d2-48a8-a5b7-f6c1a5b3f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:16.685898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1066dee-87d2-48a8-a5b7-f6c1a5b3f360 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.686197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1066dee-87d2-48a8-a5b7-f6c1a5b3f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.686948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1066dee-87d2-48a8-a5b7-f6c1a5b3f360 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.688064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1066dee-87d2-48a8-a5b7-f6c1a5b3f360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:16.691315 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1066dee-87d2-48a8-a5b7-f6c1a5b3f360 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:16.720794 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1309/2580] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:16 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:16.726235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540f4e-5bd7-4e2f-bfc9-16abd915afb0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:16.737556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540f4e-5bd7-4e2f-bfc9-16abd915afb0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:16.743611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371018c-707a-4788-bacb-ce4daafc2162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:16.743611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371018c-707a-4788-bacb-ce4daafc2162 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.743611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371018c-707a-4788-bacb-ce4daafc2162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.743611 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371018c-707a-4788-bacb-ce4daafc2162 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.744245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371018c-707a-4788-bacb-ce4daafc2162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:16.745825 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371018c-707a-4788-bacb-ce4daafc2162 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:16.757562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1272/2581] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:16.761336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1066dee-87d2-48a8-a5b7-f6c1a5b3f360 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:16.773089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1066dee-87d2-48a8-a5b7-f6c1a5b3f360 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:16.778871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75eb4b-ba5c-4021-b10e-bf1e07404054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:16.779545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75eb4b-ba5c-4021-b10e-bf1e07404054 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.779831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75eb4b-ba5c-4021-b10e-bf1e07404054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.780109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75eb4b-ba5c-4021-b10e-bf1e07404054 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.780840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75eb4b-ba5c-4021-b10e-bf1e07404054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:16.782490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75eb4b-ba5c-4021-b10e-bf1e07404054 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:16.795030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1310/2582] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:16.797663 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371018c-707a-4788-bacb-ce4daafc2162 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:16.808238 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371018c-707a-4788-bacb-ce4daafc2162 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:16.824502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3d604-9b46-4610-ade1-4bca49f4dd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:16.825488 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3d604-9b46-4610-ade1-4bca49f4dd99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.825805 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3d604-9b46-4610-ade1-4bca49f4dd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.826074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3d604-9b46-4610-ade1-4bca49f4dd99 admin admin] PATH_INFO: `/v3/projects/d12294409d8d455caf3b64ffbdcda346/users/941e6299357d4f9c9bd0746a66917c3e/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.843296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3d604-9b46-4610-ade1-4bca49f4dd99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12294409d8d455caf3b64ffbdcda346, user_id=941e6299357d4f9c9bd0746a66917c3e, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:16.846150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3d604-9b46-4610-ade1-4bca49f4dd99 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:16.862053 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1273/2583] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:16 2022] PUT /identity/v3/projects/d12294409d8d455caf3b64ffbdcda346/users/941e6299357d4f9c9bd0746a66917c3e/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:16.874261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9f2d7-9e51-49cf-8041-aecc5a049a56 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:16.874792 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9f2d7-9e51-49cf-8041-aecc5a049a56 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:16.875355 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9f2d7-9e51-49cf-8041-aecc5a049a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:16.917770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-8af9f2d7-9e51-49cf-8041-aecc5a049a56 None None] MFA Rules not processed for user `941e6299357d4f9c9bd0746a66917c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:16.919720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8af9f2d7-9e51-49cf-8041-aecc5a049a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:17.021714 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1311/2584] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:17.026910 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3d604-9b46-4610-ade1-4bca49f4dd99 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:17.123518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3d604-9b46-4610-ade1-4bca49f4dd99 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:17.129083 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d95ba-a12a-4446-a66f-4b5c1ea697f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:17.129922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d95ba-a12a-4446-a66f-4b5c1ea697f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:17.130380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d95ba-a12a-4446-a66f-4b5c1ea697f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:17.130758 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d95ba-a12a-4446-a66f-4b5c1ea697f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:17.131533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d95ba-a12a-4446-a66f-4b5c1ea697f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:17.134044 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d95ba-a12a-4446-a66f-4b5c1ea697f4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:17.179670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1274/2585] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:17 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:17.183680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9f2d7-9e51-49cf-8041-aecc5a049a56 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:17.195511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9f2d7-9e51-49cf-8041-aecc5a049a56 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:17.257170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b58f1e-8ab1-4304-8718-4d08e7034f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:17.257809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b58f1e-8ab1-4304-8718-4d08e7034f83 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:17.258090 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b58f1e-8ab1-4304-8718-4d08e7034f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:17.258362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b58f1e-8ab1-4304-8718-4d08e7034f83 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:17.259105 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b58f1e-8ab1-4304-8718-4d08e7034f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:17.261137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b58f1e-8ab1-4304-8718-4d08e7034f83 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:17.286516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1312/2586] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:17 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:17.288321 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d95ba-a12a-4446-a66f-4b5c1ea697f4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:17.301632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d95ba-a12a-4446-a66f-4b5c1ea697f4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:17.307195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14991456-40b1-495d-8b7b-15b7f3ff4b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:17.307898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14991456-40b1-495d-8b7b-15b7f3ff4b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:17.308292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14991456-40b1-495d-8b7b-15b7f3ff4b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:17.308467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14991456-40b1-495d-8b7b-15b7f3ff4b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:17.309331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14991456-40b1-495d-8b7b-15b7f3ff4b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:17.311512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14991456-40b1-495d-8b7b-15b7f3ff4b45 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:17.329003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1275/2587] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:17.329249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b58f1e-8ab1-4304-8718-4d08e7034f83 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:17.339726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b58f1e-8ab1-4304-8718-4d08e7034f83 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:17.346436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23d7a1-8af7-4ce8-b5ca-33db32f4c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:17.347686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d7a1-8af7-4ce8-b5ca-33db32f4c422 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:17.348095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d7a1-8af7-4ce8-b5ca-33db32f4c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:17.348374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d7a1-8af7-4ce8-b5ca-33db32f4c422 admin admin] PATH_INFO: `/v3/projects/53a3eb4eea3b46cc861be5b48a7841de/users/1f09549de1884831bc78c1ff6583af38/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:17.368614 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23d7a1-8af7-4ce8-b5ca-33db32f4c422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a3eb4eea3b46cc861be5b48a7841de, user_id=1f09549de1884831bc78c1ff6583af38, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:17.369639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23d7a1-8af7-4ce8-b5ca-33db32f4c422 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:17.392950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1313/2588] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:17 2022] PUT /identity/v3/projects/53a3eb4eea3b46cc861be5b48a7841de/users/1f09549de1884831bc78c1ff6583af38/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:17.396637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14991456-40b1-495d-8b7b-15b7f3ff4b45 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:17.426134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14991456-40b1-495d-8b7b-15b7f3ff4b45 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:17.522390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5f2fc-af58-4c20-af00-b50202e9d214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:17.523186 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5f2fc-af58-4c20-af00-b50202e9d214 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:17.523530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5f2fc-af58-4c20-af00-b50202e9d214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:17.523836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5f2fc-af58-4c20-af00-b50202e9d214 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:17.524580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5f2fc-af58-4c20-af00-b50202e9d214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:17.526226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5f2fc-af58-4c20-af00-b50202e9d214 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:17.537852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1276/2589] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:17.541612 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23d7a1-8af7-4ce8-b5ca-33db32f4c422 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:17.552138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23d7a1-8af7-4ce8-b5ca-33db32f4c422 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:17.557693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04cc5-94c4-45e0-9936-31513db9d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:17.559223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04cc5-94c4-45e0-9936-31513db9d8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:17.559608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04cc5-94c4-45e0-9936-31513db9d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:17.559986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04cc5-94c4-45e0-9936-31513db9d8d0 admin admin] PATH_INFO: `/v3/projects/53a3eb4eea3b46cc861be5b48a7841de/users/1f09549de1884831bc78c1ff6583af38/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:17.562574 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b04cc5-94c4-45e0-9936-31513db9d8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a3eb4eea3b46cc861be5b48a7841de, user_id=1f09549de1884831bc78c1ff6583af38, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:17.566747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b04cc5-94c4-45e0-9936-31513db9d8d0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:17.579412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1314/2590] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:17 2022] PUT /identity/v3/projects/53a3eb4eea3b46cc861be5b48a7841de/users/1f09549de1884831bc78c1ff6583af38/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:17.589787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c066f3-a76c-4cc5-8dc6-bd29c25a8088 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:17.590286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c066f3-a76c-4cc5-8dc6-bd29c25a8088 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:17.590597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c066f3-a76c-4cc5-8dc6-bd29c25a8088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:17.632152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-16c066f3-a76c-4cc5-8dc6-bd29c25a8088 None None] MFA Rules not processed for user `1f09549de1884831bc78c1ff6583af38`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:17.634993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-16c066f3-a76c-4cc5-8dc6-bd29c25a8088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:17.753676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1277/2591] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:17.764630 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04cc5-94c4-45e0-9936-31513db9d8d0 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:17.767379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c3b04cc5-94c4-45e0-9936-31513db9d8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:17.839093 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04cc5-94c4-45e0-9936-31513db9d8d0 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:17.844270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bb75d-c2a5-418c-83ab-aa7358295da3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:17.844943 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bb75d-c2a5-418c-83ab-aa7358295da3 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:17.845299 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bb75d-c2a5-418c-83ab-aa7358295da3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:17.845489 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bb75d-c2a5-418c-83ab-aa7358295da3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:17.856974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bb75d-c2a5-418c-83ab-aa7358295da3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:17.858726 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bb75d-c2a5-418c-83ab-aa7358295da3 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:17.874871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1315/2592] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:18.360516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c066f3-a76c-4cc5-8dc6-bd29c25a8088 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:18.430071 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c066f3-a76c-4cc5-8dc6-bd29c25a8088 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:18.435533 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:18.436404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:18.436686 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:18.436957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] PATH_INFO: `/v3/users/941e6299357d4f9c9bd0746a66917c3e` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:18.438180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941e6299357d4f9c9bd0746a66917c3e)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:18.440105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:18.491274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941e6299357d4f9c9bd0746a66917c3e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:18.503817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941e6299357d4f9c9bd0746a66917c3e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:18.511309 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941e6299357d4f9c9bd0746a66917c3e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:18.512348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941e6299357d4f9c9bd0746a66917c3e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:18.522426 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941e6299357d4f9c9bd0746a66917c3e'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:18.529695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1278/2593] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:18 2022] DELETE /identity/v3/users/941e6299357d4f9c9bd0746a66917c3e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:18.534215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd253c3-e10a-40fe-8483-c4499c783069 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:18.534511 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd253c3-e10a-40fe-8483-c4499c783069 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:18.534817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd253c3-e10a-40fe-8483-c4499c783069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:18.553582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-edd253c3-e10a-40fe-8483-c4499c783069 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:18.555125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-edd253c3-e10a-40fe-8483-c4499c783069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:18.633861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1316/2594] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:18.643515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:18.645165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:18.713267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37004-f903-4388-89f4-79d047990761 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:18.717606 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc9b3-4eee-4f53-88ba-91fe1105b131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:18.718287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc9b3-4eee-4f53-88ba-91fe1105b131 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:18.718514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc9b3-4eee-4f53-88ba-91fe1105b131 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:18.718826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc9b3-4eee-4f53-88ba-91fe1105b131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:18.732048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fc9b3-4eee-4f53-88ba-91fe1105b131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:18.734641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fc9b3-4eee-4f53-88ba-91fe1105b131 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:18.748596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1279/2595] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:19.084309 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd253c3-e10a-40fe-8483-c4499c783069 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:19.086223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-edd253c3-e10a-40fe-8483-c4499c783069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:19.108563 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd253c3-e10a-40fe-8483-c4499c783069 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:19.116611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:19.135371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:19.136404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:19.137348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] PATH_INFO: `/v3/projects/d12294409d8d455caf3b64ffbdcda346` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:19.139305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12294409d8d455caf3b64ffbdcda346)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:19.142965 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:19.215895 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12294409d8d455caf3b64ffbdcda346', 'request_id': 'req-e92c8fd4-141e-408b-94a9-0a1d48dfa048'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.225294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12294409d8d455caf3b64ffbdcda346', 'request_id': 'req-e92c8fd4-141e-408b-94a9-0a1d48dfa048'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.233476 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12294409d8d455caf3b64ffbdcda346', 'request_id': 'req-e92c8fd4-141e-408b-94a9-0a1d48dfa048'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.244827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] The token cache is being invalidate because project d12294409d8d455caf3b64ffbdcda346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:19.245262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.246054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.248001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1317/2596] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:19 2022] DELETE /identity/v3/projects/d12294409d8d455caf3b64ffbdcda346 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:19.251990 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc9b3-4eee-4f53-88ba-91fe1105b131 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:19.262224 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc9b3-4eee-4f53-88ba-91fe1105b131 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:19.326316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:19.327378 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:19.327785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:19.329485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] PATH_INFO: `/v3/users/1f09549de1884831bc78c1ff6583af38` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:19.332011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f09549de1884831bc78c1ff6583af38)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:19.336593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:19.393182 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f09549de1884831bc78c1ff6583af38'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.411021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f09549de1884831bc78c1ff6583af38'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.420922 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f09549de1884831bc78c1ff6583af38'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.421856 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f09549de1884831bc78c1ff6583af38'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.435091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-19c120a2-530a-4298-9727-b459faa07dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f09549de1884831bc78c1ff6583af38'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.444014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1280/2597] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:19 2022] DELETE /identity/v3/users/1f09549de1884831bc78c1ff6583af38 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:19.804717 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:19.806782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:19.829996 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8fd4-141e-408b-94a9-0a1d48dfa048 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:19.908589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:19.909372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:19.909905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:19.910350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] PATH_INFO: `/v3/projects/53a3eb4eea3b46cc861be5b48a7841de` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:19.911573 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a3eb4eea3b46cc861be5b48a7841de)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:19.913477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:19.966135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a3eb4eea3b46cc861be5b48a7841de', 'request_id': 'req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.981902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a3eb4eea3b46cc861be5b48a7841de', 'request_id': 'req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:19.991687 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a3eb4eea3b46cc861be5b48a7841de', 'request_id': 'req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:20.005255 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] The token cache is being invalidate because project 53a3eb4eea3b46cc861be5b48a7841de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:20.006187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:20.006907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-95f4d1ae-c01e-4f7b-be95-1df9110ec05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:20.014591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1318/2598] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:19 2022] DELETE /identity/v3/projects/53a3eb4eea3b46cc861be5b48a7841de => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:20.016689 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199425fe-7a91-4905-bb91-7dfcc964c033 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.016978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199425fe-7a91-4905-bb91-7dfcc964c033 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.017255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199425fe-7a91-4905-bb91-7dfcc964c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.036857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-199425fe-7a91-4905-bb91-7dfcc964c033 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:20.038115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-199425fe-7a91-4905-bb91-7dfcc964c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:20.100218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1281/2599] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:20.109689 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ebbe6-e5e3-4a85-8356-3fc28f2adf2e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.110279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ebbe6-e5e3-4a85-8356-3fc28f2adf2e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.110279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ebbe6-e5e3-4a85-8356-3fc28f2adf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.135858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-131ebbe6-e5e3-4a85-8356-3fc28f2adf2e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:20.137122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-131ebbe6-e5e3-4a85-8356-3fc28f2adf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:20.146535 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1319/2600] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:20.150800 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199425fe-7a91-4905-bb91-7dfcc964c033 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:20.167771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199425fe-7a91-4905-bb91-7dfcc964c033 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:20.175809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0e05e-0b55-4a62-9517-7257698024a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:20.175809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0e05e-0b55-4a62-9517-7257698024a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.175809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0e05e-0b55-4a62-9517-7257698024a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.176262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0e05e-0b55-4a62-9517-7257698024a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.177194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0e05e-0b55-4a62-9517-7257698024a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:20.177599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0e05e-0b55-4a62-9517-7257698024a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:20.179354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0e05e-0b55-4a62-9517-7257698024a2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:20.198374 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ebbe6-e5e3-4a85-8356-3fc28f2adf2e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:20.204246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1282/2601] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:06:20.208876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ebbe6-e5e3-4a85-8356-3fc28f2adf2e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:20.213851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d23ca-a70f-4a30-af7f-915c830bad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:20.214525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d23ca-a70f-4a30-af7f-915c830bad54 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.214809 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d23ca-a70f-4a30-af7f-915c830bad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.215081 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d23ca-a70f-4a30-af7f-915c830bad54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.215782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d23ca-a70f-4a30-af7f-915c830bad54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:20.217730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d23ca-a70f-4a30-af7f-915c830bad54 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:20.250158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0e05e-0b55-4a62-9517-7257698024a2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:20.253607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1320/2602] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:20 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:20.261029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0e05e-0b55-4a62-9517-7257698024a2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:20.335197 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bceda-3310-4764-bcdf-5282696232d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:20.335897 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bceda-3310-4764-bcdf-5282696232d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.336180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bceda-3310-4764-bcdf-5282696232d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.336456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bceda-3310-4764-bcdf-5282696232d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.337135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bceda-3310-4764-bcdf-5282696232d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:20.339091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bceda-3310-4764-bcdf-5282696232d5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:20.361232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1283/2603] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:20 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:20.364931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d23ca-a70f-4a30-af7f-915c830bad54 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:20.378875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d23ca-a70f-4a30-af7f-915c830bad54 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:20.384198 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba834c0-4d43-40d7-8cb5-06d09b6bac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:20.384872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba834c0-4d43-40d7-8cb5-06d09b6bac32 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.385194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba834c0-4d43-40d7-8cb5-06d09b6bac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.385562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba834c0-4d43-40d7-8cb5-06d09b6bac32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.386846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba834c0-4d43-40d7-8cb5-06d09b6bac32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:20.388837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba834c0-4d43-40d7-8cb5-06d09b6bac32 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:20.403130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1321/2604] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:20.407368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bceda-3310-4764-bcdf-5282696232d5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:20.417673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bceda-3310-4764-bcdf-5282696232d5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:20.427357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbf539-9d6f-45ba-a87a-dde50094c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:20.428080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf539-9d6f-45ba-a87a-dde50094c274 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.428479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf539-9d6f-45ba-a87a-dde50094c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.428842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf539-9d6f-45ba-a87a-dde50094c274 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.429717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbf539-9d6f-45ba-a87a-dde50094c274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:20.431427 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbf539-9d6f-45ba-a87a-dde50094c274 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:20.446245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1284/2605] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:20.450522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba834c0-4d43-40d7-8cb5-06d09b6bac32 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:20.461408 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba834c0-4d43-40d7-8cb5-06d09b6bac32 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:20.467402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18a468-43c8-47ca-887f-c59bc6598ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:20.468372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18a468-43c8-47ca-887f-c59bc6598ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.468727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18a468-43c8-47ca-887f-c59bc6598ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.469211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18a468-43c8-47ca-887f-c59bc6598ca5 admin admin] PATH_INFO: `/v3/projects/2110f15cb17e45b78dbac9d2ff603582/users/fb2be205ae4a433f855d9d53423696c5/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.487056 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18a468-43c8-47ca-887f-c59bc6598ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2110f15cb17e45b78dbac9d2ff603582, user_id=fb2be205ae4a433f855d9d53423696c5, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:20.490518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18a468-43c8-47ca-887f-c59bc6598ca5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:20.514096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1322/2606] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:20 2022] PUT /identity/v3/projects/2110f15cb17e45b78dbac9d2ff603582/users/fb2be205ae4a433f855d9d53423696c5/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:20.525624 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef614-d0d0-417d-b6df-80bf7c5fe8b0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.526024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef614-d0d0-417d-b6df-80bf7c5fe8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.526440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef614-d0d0-417d-b6df-80bf7c5fe8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.560376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-9c2ef614-d0d0-417d-b6df-80bf7c5fe8b0 None None] MFA Rules not processed for user `fb2be205ae4a433f855d9d53423696c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:20.562369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9c2ef614-d0d0-417d-b6df-80bf7c5fe8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:20.634219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1285/2607] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:20.645466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18a468-43c8-47ca-887f-c59bc6598ca5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:20.647364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3d18a468-43c8-47ca-887f-c59bc6598ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:20.718422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18a468-43c8-47ca-887f-c59bc6598ca5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:20.723206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ee780-aa73-43ee-a72d-ae23037ebc1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066d62c015e9483e87e4bd64ce8c4df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:20.724587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ee780-aa73-43ee-a72d-ae23037ebc1b service glance] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:20.724877 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ee780-aa73-43ee-a72d-ae23037ebc1b service glance] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:20.725185 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ee780-aa73-43ee-a72d-ae23037ebc1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:20.735231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ee780-aa73-43ee-a72d-ae23037ebc1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:20.736711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ee780-aa73-43ee-a72d-ae23037ebc1b service glance] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:20.747192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1323/2608] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:25.122041 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ef614-d0d0-417d-b6df-80bf7c5fe8b0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:25.124128 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9c2ef614-d0d0-417d-b6df-80bf7c5fe8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:25.245110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ef614-d0d0-417d-b6df-80bf7c5fe8b0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:25.263916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:25.264767 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:25.265046 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:25.265335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] PATH_INFO: `/v3/users/0b0e729d99ee48b6b9cb69c2f852b510` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:25.266608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0e729d99ee48b6b9cb69c2f852b510)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:25.268899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:25.334373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0e729d99ee48b6b9cb69c2f852b510'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:25.349901 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0e729d99ee48b6b9cb69c2f852b510'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:25.361958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0e729d99ee48b6b9cb69c2f852b510'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:25.362817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0e729d99ee48b6b9cb69c2f852b510'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:25.372400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0e729d99ee48b6b9cb69c2f852b510'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:25.383377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1286/2609] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:25 2022] DELETE /identity/v3/users/0b0e729d99ee48b6b9cb69c2f852b510 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:25.384743 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8c63-30b4-4e05-bbdd-75666a52cc9e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:25.385237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8c63-30b4-4e05-bbdd-75666a52cc9e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:25.385337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8c63-30b4-4e05-bbdd-75666a52cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:25.413107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-3d2e8c63-30b4-4e05-bbdd-75666a52cc9e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:25.414433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3d2e8c63-30b4-4e05-bbdd-75666a52cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:25.513371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1324/2610] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:25.527440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:25.531380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:25.649978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a855500-b3f8-4200-8c6d-33c80bcd47f0 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:25.654976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9013cc-f33f-401b-b21b-66203ca30f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:25.655709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9013cc-f33f-401b-b21b-66203ca30f86 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:25.656058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9013cc-f33f-401b-b21b-66203ca30f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:25.656407 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9013cc-f33f-401b-b21b-66203ca30f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:25.671966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9013cc-f33f-401b-b21b-66203ca30f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:25.673683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9013cc-f33f-401b-b21b-66203ca30f86 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:25.689231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1287/2611] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:25.981510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e8c63-30b4-4e05-bbdd-75666a52cc9e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:25.984265 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3d2e8c63-30b4-4e05-bbdd-75666a52cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:26.002472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e8c63-30b4-4e05-bbdd-75666a52cc9e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:26.010858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:26.011465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.011748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.012025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] PATH_INFO: `/v3/projects/5a752f7bb3724478a8dd0f9dbb7c74d6` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.014323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a752f7bb3724478a8dd0f9dbb7c74d6)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:26.016739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:26.069766 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a752f7bb3724478a8dd0f9dbb7c74d6', 'request_id': 'req-e586adcc-7b27-44e5-a636-974af1571db8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:26.078134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a752f7bb3724478a8dd0f9dbb7c74d6', 'request_id': 'req-e586adcc-7b27-44e5-a636-974af1571db8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:26.085805 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a752f7bb3724478a8dd0f9dbb7c74d6', 'request_id': 'req-e586adcc-7b27-44e5-a636-974af1571db8'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:26.096513 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] The token cache is being invalidate because project 5a752f7bb3724478a8dd0f9dbb7c74d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:26.097143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:26.097678 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-e586adcc-7b27-44e5-a636-974af1571db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:26.099321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1325/2612] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:25 2022] DELETE /identity/v3/projects/5a752f7bb3724478a8dd0f9dbb7c74d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:26.104110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fe196-8939-46d4-bb22-dcb0eaa15aa4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.104400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fe196-8939-46d4-bb22-dcb0eaa15aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.104680 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fe196-8939-46d4-bb22-dcb0eaa15aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.125353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d28fe196-8939-46d4-bb22-dcb0eaa15aa4 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:26.127474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d28fe196-8939-46d4-bb22-dcb0eaa15aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:26.194603 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1288/2613] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:26.203913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238a18e-c126-430a-8161-e902f018e4b7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.204211 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238a18e-c126-430a-8161-e902f018e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.204493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238a18e-c126-430a-8161-e902f018e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.225235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4238a18e-c126-430a-8161-e902f018e4b7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:26.227378 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4238a18e-c126-430a-8161-e902f018e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:26.235932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1326/2614] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:26.240360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fe196-8939-46d4-bb22-dcb0eaa15aa4 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:26.250108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fe196-8939-46d4-bb22-dcb0eaa15aa4 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:26.254877 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131980d-7293-477b-8dbe-3a13215e9f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:26.256034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131980d-7293-477b-8dbe-3a13215e9f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.256328 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131980d-7293-477b-8dbe-3a13215e9f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.256604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131980d-7293-477b-8dbe-3a13215e9f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.257335 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131980d-7293-477b-8dbe-3a13215e9f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:26.257682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131980d-7293-477b-8dbe-3a13215e9f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:26.259282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131980d-7293-477b-8dbe-3a13215e9f2e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:26.279171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238a18e-c126-430a-8161-e902f018e4b7 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:26.285605 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1289/2615] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:06:26.290485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238a18e-c126-430a-8161-e902f018e4b7 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:26.298769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb0e57-5952-46a9-a4d7-5b9ba9c0b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:26.299455 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb0e57-5952-46a9-a4d7-5b9ba9c0b7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.299730 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb0e57-5952-46a9-a4d7-5b9ba9c0b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.300003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb0e57-5952-46a9-a4d7-5b9ba9c0b7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.300703 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb0e57-5952-46a9-a4d7-5b9ba9c0b7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:26.302704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb0e57-5952-46a9-a4d7-5b9ba9c0b7c6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:26.333900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1327/2616] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:26 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:26.336474 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131980d-7293-477b-8dbe-3a13215e9f2e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:26.347134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131980d-7293-477b-8dbe-3a13215e9f2e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:26.407123 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b94b-bfdf-4752-b619-550ece977513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:26.407796 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b94b-bfdf-4752-b619-550ece977513 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.408085 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b94b-bfdf-4752-b619-550ece977513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.408360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b94b-bfdf-4752-b619-550ece977513 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.409923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5b94b-bfdf-4752-b619-550ece977513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:26.414362 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5b94b-bfdf-4752-b619-550ece977513 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:26.441749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1290/2617] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:26 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:26.446238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb0e57-5952-46a9-a4d7-5b9ba9c0b7c6 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:26.457554 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb0e57-5952-46a9-a4d7-5b9ba9c0b7c6 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:26.463941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb971-fbe3-4613-a743-a798ec494df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:26.464761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb971-fbe3-4613-a743-a798ec494df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.465046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb971-fbe3-4613-a743-a798ec494df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.465319 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb971-fbe3-4613-a743-a798ec494df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.466592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebb971-fbe3-4613-a743-a798ec494df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:26.468430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebb971-fbe3-4613-a743-a798ec494df8 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:26.484682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1328/2618] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:26.494722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b94b-bfdf-4752-b619-550ece977513 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:26.505874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b94b-bfdf-4752-b619-550ece977513 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:26.510788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821d61-560f-411c-99e4-70cbfe7aa3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:26.511517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821d61-560f-411c-99e4-70cbfe7aa3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.511802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821d61-560f-411c-99e4-70cbfe7aa3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.512081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821d61-560f-411c-99e4-70cbfe7aa3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.512861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc821d61-560f-411c-99e4-70cbfe7aa3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:26.514817 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc821d61-560f-411c-99e4-70cbfe7aa3a8 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:26.530125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1291/2619] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:26.532114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb971-fbe3-4613-a743-a798ec494df8 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:26.549298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb971-fbe3-4613-a743-a798ec494df8 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:26.556285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ba0c2-969c-4dd7-9947-6a0dcced50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:26.561710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ba0c2-969c-4dd7-9947-6a0dcced50a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.561710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ba0c2-969c-4dd7-9947-6a0dcced50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.561710 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ba0c2-969c-4dd7-9947-6a0dcced50a5 admin admin] PATH_INFO: `/v3/projects/301fe21ed41349a0a490a732d588317e/users/0767a6d9a61d4d2aa1ed6d845ba9d850/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.580239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ba0c2-969c-4dd7-9947-6a0dcced50a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301fe21ed41349a0a490a732d588317e, user_id=0767a6d9a61d4d2aa1ed6d845ba9d850, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:26.583554 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ba0c2-969c-4dd7-9947-6a0dcced50a5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:26.600690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1329/2620] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:26 2022] PUT /identity/v3/projects/301fe21ed41349a0a490a732d588317e/users/0767a6d9a61d4d2aa1ed6d845ba9d850/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:26.611256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554177e-3290-4dac-b3b8-f5b501af7caf None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.611640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554177e-3290-4dac-b3b8-f5b501af7caf None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.611993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554177e-3290-4dac-b3b8-f5b501af7caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.644060 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-c554177e-3290-4dac-b3b8-f5b501af7caf None None] MFA Rules not processed for user `0767a6d9a61d4d2aa1ed6d845ba9d850`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:26.645301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c554177e-3290-4dac-b3b8-f5b501af7caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:26.749133 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1292/2621] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:26.764188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ba0c2-969c-4dd7-9947-6a0dcced50a5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:26.854663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ba0c2-969c-4dd7-9947-6a0dcced50a5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:26.862583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9491-7070-4810-9ea7-b9565c900cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:26.863554 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9491-7070-4810-9ea7-b9565c900cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.863964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9491-7070-4810-9ea7-b9565c900cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.864811 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9491-7070-4810-9ea7-b9565c900cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.866376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b9491-7070-4810-9ea7-b9565c900cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:26.868470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b9491-7070-4810-9ea7-b9565c900cb0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:26.909584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1330/2622] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:26 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:26.911754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554177e-3290-4dac-b3b8-f5b501af7caf None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:26.922811 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554177e-3290-4dac-b3b8-f5b501af7caf None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:26.989262 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef047-0b92-489e-8a00-d205d7faab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:26.990029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef047-0b92-489e-8a00-d205d7faab04 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:26.990318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef047-0b92-489e-8a00-d205d7faab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:26.990597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef047-0b92-489e-8a00-d205d7faab04 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:26.991291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef047-0b92-489e-8a00-d205d7faab04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:26.993334 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef047-0b92-489e-8a00-d205d7faab04 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:27.022061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1293/2623] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:26 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:27.023337 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9491-7070-4810-9ea7-b9565c900cb0 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:27.035605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9491-7070-4810-9ea7-b9565c900cb0 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:27.041111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3861b-8ee8-4dbf-947b-3d2988492582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:27.041784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3861b-8ee8-4dbf-947b-3d2988492582 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:27.042107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3861b-8ee8-4dbf-947b-3d2988492582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:27.042386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3861b-8ee8-4dbf-947b-3d2988492582 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:27.043146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3861b-8ee8-4dbf-947b-3d2988492582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:27.044882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3861b-8ee8-4dbf-947b-3d2988492582 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:27.059219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1331/2624] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:06:27.063123 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef047-0b92-489e-8a00-d205d7faab04 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:27.074369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef047-0b92-489e-8a00-d205d7faab04 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:27.080483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccab75-dac5-4361-a7f5-93d10210ba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:27.082606 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccab75-dac5-4361-a7f5-93d10210ba0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:27.083003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccab75-dac5-4361-a7f5-93d10210ba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:27.083353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccab75-dac5-4361-a7f5-93d10210ba0c admin admin] PATH_INFO: `/v3/projects/1025124f6caa48a9854a6f965deb7579/users/a9a0cc8ef9144453967ed1782119afe7/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:27.101012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccab75-dac5-4361-a7f5-93d10210ba0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1025124f6caa48a9854a6f965deb7579, user_id=a9a0cc8ef9144453967ed1782119afe7, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:27.103826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccab75-dac5-4361-a7f5-93d10210ba0c admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:27.117748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1294/2625] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:27 2022] PUT /identity/v3/projects/1025124f6caa48a9854a6f965deb7579/users/a9a0cc8ef9144453967ed1782119afe7/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:27.121890 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3861b-8ee8-4dbf-947b-3d2988492582 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:27.132987 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3861b-8ee8-4dbf-947b-3d2988492582 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:27.199111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71471b-537b-4609-b3aa-e031cd2453d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:27.199790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71471b-537b-4609-b3aa-e031cd2453d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:27.200098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71471b-537b-4609-b3aa-e031cd2453d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:27.200376 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71471b-537b-4609-b3aa-e031cd2453d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:27.201136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71471b-537b-4609-b3aa-e031cd2453d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:27.202810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71471b-537b-4609-b3aa-e031cd2453d2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:27.215150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1332/2626] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:27.219318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccab75-dac5-4361-a7f5-93d10210ba0c admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:27.231513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccab75-dac5-4361-a7f5-93d10210ba0c admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:27.237833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592cf0c-955e-4765-a8d0-8623d311102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:27.238802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cf0c-955e-4765-a8d0-8623d311102a admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:27.239114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cf0c-955e-4765-a8d0-8623d311102a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:27.240061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cf0c-955e-4765-a8d0-8623d311102a admin admin] PATH_INFO: `/v3/projects/1025124f6caa48a9854a6f965deb7579/users/a9a0cc8ef9144453967ed1782119afe7/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:27.242108 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592cf0c-955e-4765-a8d0-8623d311102a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1025124f6caa48a9854a6f965deb7579, user_id=a9a0cc8ef9144453967ed1782119afe7, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:27.245032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592cf0c-955e-4765-a8d0-8623d311102a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:27.256513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1295/2627] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:27 2022] PUT /identity/v3/projects/1025124f6caa48a9854a6f965deb7579/users/a9a0cc8ef9144453967ed1782119afe7/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:27.267067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767295-a584-4810-82ba-cb31c3cb4ead None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:27.267361 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767295-a584-4810-82ba-cb31c3cb4ead None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:27.267647 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767295-a584-4810-82ba-cb31c3cb4ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:27.303490 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d4767295-a584-4810-82ba-cb31c3cb4ead None None] MFA Rules not processed for user `a9a0cc8ef9144453967ed1782119afe7`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:27.304736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d4767295-a584-4810-82ba-cb31c3cb4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:27.383547 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1333/2628] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:27.394069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592cf0c-955e-4765-a8d0-8623d311102a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:27.396419 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1592cf0c-955e-4765-a8d0-8623d311102a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:27.460069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592cf0c-955e-4765-a8d0-8623d311102a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:27.464769 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fb374-a005-412f-a708-6ecc5ebe13ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:27.465461 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fb374-a005-412f-a708-6ecc5ebe13ab service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:27.465779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fb374-a005-412f-a708-6ecc5ebe13ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:27.466059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fb374-a005-412f-a708-6ecc5ebe13ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:27.529940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fb374-a005-412f-a708-6ecc5ebe13ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:27.531618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fb374-a005-412f-a708-6ecc5ebe13ab service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:27.541701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1296/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:27.952214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767295-a584-4810-82ba-cb31c3cb4ead None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:27.954426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d4767295-a584-4810-82ba-cb31c3cb4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:28.024960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767295-a584-4810-82ba-cb31c3cb4ead None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:28.030099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:28.031032 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:28.031381 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:28.031721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] PATH_INFO: `/v3/users/2db3fd1cb40d4bce8245b9119b64eace` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:28.032968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db3fd1cb40d4bce8245b9119b64eace)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:28.034905 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:28.084620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db3fd1cb40d4bce8245b9119b64eace'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.085336 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db3fd1cb40d4bce8245b9119b64eace'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.096481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db3fd1cb40d4bce8245b9119b64eace'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.097095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db3fd1cb40d4bce8245b9119b64eace'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.104739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db3fd1cb40d4bce8245b9119b64eace'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.116830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1334/2630] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:27 2022] DELETE /identity/v3/users/2db3fd1cb40d4bce8245b9119b64eace => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:28.121295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afb04-d07f-4879-bcf5-2dca5fb3fe85 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:28.121655 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afb04-d07f-4879-bcf5-2dca5fb3fe85 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:28.122032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afb04-d07f-4879-bcf5-2dca5fb3fe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:28.139964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-cf2afb04-d07f-4879-bcf5-2dca5fb3fe85 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:28.141240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cf2afb04-d07f-4879-bcf5-2dca5fb3fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:28.200306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1297/2631] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:28.210456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:28.211853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:28.266307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd355-ff78-4dd7-a5f7-861a093f8ea2 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:28.269950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d327c0-75c8-4e96-8aa6-86c431fa7d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:28.271085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d327c0-75c8-4e96-8aa6-86c431fa7d30 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:28.271365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d327c0-75c8-4e96-8aa6-86c431fa7d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:28.271639 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d327c0-75c8-4e96-8aa6-86c431fa7d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:28.280636 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d327c0-75c8-4e96-8aa6-86c431fa7d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:28.282107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d327c0-75c8-4e96-8aa6-86c431fa7d30 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:28.291899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1335/2632] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:28.563091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afb04-d07f-4879-bcf5-2dca5fb3fe85 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:28.564879 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-cf2afb04-d07f-4879-bcf5-2dca5fb3fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:28.582527 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afb04-d07f-4879-bcf5-2dca5fb3fe85 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:28.589075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:28.590049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:28.590382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:28.590754 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] PATH_INFO: `/v3/projects/3e668bad253d4180a4c13a567e4f1b89` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:28.591981 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e668bad253d4180a4c13a567e4f1b89)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:28.594015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:28.648001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e668bad253d4180a4c13a567e4f1b89', 'request_id': 'req-7da9bf8f-bcd0-4476-95db-b009e42de35d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.655318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e668bad253d4180a4c13a567e4f1b89', 'request_id': 'req-7da9bf8f-bcd0-4476-95db-b009e42de35d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.662271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e668bad253d4180a4c13a567e4f1b89', 'request_id': 'req-7da9bf8f-bcd0-4476-95db-b009e42de35d'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.672687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] The token cache is being invalidate because project 3e668bad253d4180a4c13a567e4f1b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:28.672978 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.673690 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.675244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1298/2633] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:28 2022] DELETE /identity/v3/projects/3e668bad253d4180a4c13a567e4f1b89 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:28.679419 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d327c0-75c8-4e96-8aa6-86c431fa7d30 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:28.689642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d327c0-75c8-4e96-8aa6-86c431fa7d30 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:28.750024 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:28.750898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:28.751192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:28.751467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] PATH_INFO: `/v3/users/4e8f4bd52e574b6d9e889c0eae702636` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:28.752707 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8f4bd52e574b6d9e889c0eae702636)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:28.755160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:28.809180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8f4bd52e574b6d9e889c0eae702636'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.809865 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8f4bd52e574b6d9e889c0eae702636'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.821752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8f4bd52e574b6d9e889c0eae702636'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.822398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8f4bd52e574b6d9e889c0eae702636'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.829452 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-2e0be005-9e7e-4c20-a8b3-a350686caf4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8f4bd52e574b6d9e889c0eae702636'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:28.841733 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1336/2634] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:28 2022] DELETE /identity/v3/users/4e8f4bd52e574b6d9e889c0eae702636 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:29.136670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:29.138285 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:29.154154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bf8f-bcd0-4476-95db-b009e42de35d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:29.182785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ea9c1-2b1e-4ab3-9535-81dfbe072e58 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.183285 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ea9c1-2b1e-4ab3-9535-81dfbe072e58 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.183386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ea9c1-2b1e-4ab3-9535-81dfbe072e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.202493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-202ea9c1-2b1e-4ab3-9535-81dfbe072e58 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:29.203619 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-202ea9c1-2b1e-4ab3-9535-81dfbe072e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:29.220168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:29.221383 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.221886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.222164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] PATH_INFO: `/v3/projects/35bd06e445a94320a66ae275b57c5d85` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.223441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35bd06e445a94320a66ae275b57c5d85)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:29.225881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:29.260390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1337/2635] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 12 19:06:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:29.272220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35bd06e445a94320a66ae275b57c5d85', 'request_id': 'req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:29.273716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ea9c1-2b1e-4ab3-9535-81dfbe072e58 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:29.275132 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-202ea9c1-2b1e-4ab3-9535-81dfbe072e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:29.281091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35bd06e445a94320a66ae275b57c5d85', 'request_id': 'req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:29.288188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35bd06e445a94320a66ae275b57c5d85', 'request_id': 'req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:29.304163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] The token cache is being invalidate because project 35bd06e445a94320a66ae275b57c5d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:29.304529 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:29.305398 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6e4077f2-4a6c-4c6f-bb40-c21754edd4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:29.307030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1299/2636] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:29 2022] DELETE /identity/v3/projects/35bd06e445a94320a66ae275b57c5d85 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:29.311761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71665ff-9de4-429f-9165-7748f5449958 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.312069 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71665ff-9de4-429f-9165-7748f5449958 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.312328 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71665ff-9de4-429f-9165-7748f5449958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.335336 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-d71665ff-9de4-429f-9165-7748f5449958 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:29.336567 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-d71665ff-9de4-429f-9165-7748f5449958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:29.358397 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ea9c1-2b1e-4ab3-9535-81dfbe072e58 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:29.396650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1300/2637] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:29.405626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c4786-5776-4792-b6eb-077f0a326dec None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.405938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c4786-5776-4792-b6eb-077f0a326dec None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.407221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c4786-5776-4792-b6eb-077f0a326dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.420605 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930142-289f-43e1-b65a-96bd71aadeeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:29.421260 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930142-289f-43e1-b65a-96bd71aadeeb service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.421631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930142-289f-43e1-b65a-96bd71aadeeb service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.422084 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930142-289f-43e1-b65a-96bd71aadeeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.423771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d7930142-289f-43e1-b65a-96bd71aadeeb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:29.432637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-154c4786-5776-4792-b6eb-077f0a326dec None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:29.433893 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-154c4786-5776-4792-b6eb-077f0a326dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:29.443096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1301/2638] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:29.447467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c4786-5776-4792-b6eb-077f0a326dec None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:29.456510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c4786-5776-4792-b6eb-077f0a326dec None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:29.461826 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9231c31-c83e-4d1f-81e5-67076f790b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:29.462483 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9231c31-c83e-4d1f-81e5-67076f790b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.462774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9231c31-c83e-4d1f-81e5-67076f790b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.463078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9231c31-c83e-4d1f-81e5-67076f790b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.463851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9231c31-c83e-4d1f-81e5-67076f790b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:29.464167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9231c31-c83e-4d1f-81e5-67076f790b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:29.465886 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9231c31-c83e-4d1f-81e5-67076f790b9d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:29.480641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1302/2639] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:06:29.481621 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9231c31-c83e-4d1f-81e5-67076f790b9d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:29.483091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930142-289f-43e1-b65a-96bd71aadeeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:29.484691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930142-289f-43e1-b65a-96bd71aadeeb service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:29.491181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9231c31-c83e-4d1f-81e5-67076f790b9d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:29.492765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1338/2640] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:06:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 19:06:29.496920 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad55b53-47f0-4a94-9f68-dfdb9be392ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:29.497849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad55b53-47f0-4a94-9f68-dfdb9be392ff admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.498208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad55b53-47f0-4a94-9f68-dfdb9be392ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.498561 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad55b53-47f0-4a94-9f68-dfdb9be392ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.499432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad55b53-47f0-4a94-9f68-dfdb9be392ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:29.501325 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad55b53-47f0-4a94-9f68-dfdb9be392ff admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:29.532853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1303/2641] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:29 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:29.537259 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930142-289f-43e1-b65a-96bd71aadeeb service swift] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:29.549099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930142-289f-43e1-b65a-96bd71aadeeb service swift] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:29.607171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664550e4-74d7-415d-96c4-2a5976d9a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:29.607853 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664550e4-74d7-415d-96c4-2a5976d9a444 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.608138 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664550e4-74d7-415d-96c4-2a5976d9a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.608410 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664550e4-74d7-415d-96c4-2a5976d9a444 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.609098 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664550e4-74d7-415d-96c4-2a5976d9a444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:29.611048 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664550e4-74d7-415d-96c4-2a5976d9a444 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:29.643274 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1339/2642] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:29 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:29.645003 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad55b53-47f0-4a94-9f68-dfdb9be392ff admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:29.657694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad55b53-47f0-4a94-9f68-dfdb9be392ff admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:29.663589 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6183dc-628e-489d-be3f-eedff2eb905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:29.664274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6183dc-628e-489d-be3f-eedff2eb905d admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.664582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6183dc-628e-489d-be3f-eedff2eb905d admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.664862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6183dc-628e-489d-be3f-eedff2eb905d admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.665765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6183dc-628e-489d-be3f-eedff2eb905d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:29.667271 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6183dc-628e-489d-be3f-eedff2eb905d admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:29.677958 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1304/2643] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:06:29.682495 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664550e4-74d7-415d-96c4-2a5976d9a444 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:29.693097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664550e4-74d7-415d-96c4-2a5976d9a444 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:29.698141 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94793b4-7469-4880-aaab-db5489af3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:29.698812 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94793b4-7469-4880-aaab-db5489af3c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.699096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94793b4-7469-4880-aaab-db5489af3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.699353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94793b4-7469-4880-aaab-db5489af3c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.700076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94793b4-7469-4880-aaab-db5489af3c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:29.701721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94793b4-7469-4880-aaab-db5489af3c69 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:29.713498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1340/2644] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:29.717756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6183dc-628e-489d-be3f-eedff2eb905d admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:29.730325 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6183dc-628e-489d-be3f-eedff2eb905d admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:29.737014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba604f2-3e75-491b-a1ed-3d1b8276ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:29.738026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba604f2-3e75-491b-a1ed-3d1b8276ebd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.738402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba604f2-3e75-491b-a1ed-3d1b8276ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.738756 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba604f2-3e75-491b-a1ed-3d1b8276ebd3 admin admin] PATH_INFO: `/v3/projects/1713816a54e34a57838670fb53c891bf/users/2b27f98639e5491a9cf67c2e333b5df5/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.764788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba604f2-3e75-491b-a1ed-3d1b8276ebd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1713816a54e34a57838670fb53c891bf, user_id=2b27f98639e5491a9cf67c2e333b5df5, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:29.767609 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba604f2-3e75-491b-a1ed-3d1b8276ebd3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:29.782226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1305/2645] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:29 2022] PUT /identity/v3/projects/1713816a54e34a57838670fb53c891bf/users/2b27f98639e5491a9cf67c2e333b5df5/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:29.793265 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca49eb-b8be-4f64-9a7f-41a85b7986ee None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.794208 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca49eb-b8be-4f64-9a7f-41a85b7986ee None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.794498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca49eb-b8be-4f64-9a7f-41a85b7986ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.847268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-bfca49eb-b8be-4f64-9a7f-41a85b7986ee None None] MFA Rules not processed for user `2b27f98639e5491a9cf67c2e333b5df5`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:29.849223 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bfca49eb-b8be-4f64-9a7f-41a85b7986ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:29.920460 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1341/2646] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:29.924581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba604f2-3e75-491b-a1ed-3d1b8276ebd3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:29.985126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba604f2-3e75-491b-a1ed-3d1b8276ebd3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:29.989868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d320ca9-b3e9-453d-bf38-e6aa9ecf96d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:29.990519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d320ca9-b3e9-453d-bf38-e6aa9ecf96d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:29.990799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d320ca9-b3e9-453d-bf38-e6aa9ecf96d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:29.991075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d320ca9-b3e9-453d-bf38-e6aa9ecf96d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:29.991748 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d320ca9-b3e9-453d-bf38-e6aa9ecf96d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:29.993798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d320ca9-b3e9-453d-bf38-e6aa9ecf96d9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.022171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1306/2647] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:29 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:30.026503 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca49eb-b8be-4f64-9a7f-41a85b7986ee None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.040137 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca49eb-b8be-4f64-9a7f-41a85b7986ee None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:30.095790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a59e-76a6-42df-b414-554d6fb22205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:30.096741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a59e-76a6-42df-b414-554d6fb22205 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.097027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a59e-76a6-42df-b414-554d6fb22205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.097303 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a59e-76a6-42df-b414-554d6fb22205 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.098012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a59e-76a6-42df-b414-554d6fb22205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:30.100501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a59e-76a6-42df-b414-554d6fb22205 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.120339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1342/2648] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:30 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:30.124049 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d320ca9-b3e9-453d-bf38-e6aa9ecf96d9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.136637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d320ca9-b3e9-453d-bf38-e6aa9ecf96d9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:30.141986 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ab4b-1cba-460f-b73f-88226e9a9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:30.142659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ab4b-1cba-460f-b73f-88226e9a9491 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.142949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ab4b-1cba-460f-b73f-88226e9a9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.143053 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a59e-76a6-42df-b414-554d6fb22205 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.143331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ab4b-1cba-460f-b73f-88226e9a9491 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.144016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ab4b-1cba-460f-b73f-88226e9a9491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:30.145037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-b883a59e-76a6-42df-b414-554d6fb22205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:30.145828 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ab4b-1cba-460f-b73f-88226e9a9491 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.157400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a59e-76a6-42df-b414-554d6fb22205 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:30.161861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1307/2649] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:30.162670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ab4b-1cba-460f-b73f-88226e9a9491 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.162790 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:30.163558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.163846 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.169134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] PATH_INFO: `/v3/users/0767a6d9a61d4d2aa1ed6d845ba9d850` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.170633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0767a6d9a61d4d2aa1ed6d845ba9d850)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:30.172897 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.173055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ab4b-1cba-460f-b73f-88226e9a9491 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:30.178394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223e0ed-af44-46b3-b37e-6b36287b9df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:30.179312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223e0ed-af44-46b3-b37e-6b36287b9df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.179599 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223e0ed-af44-46b3-b37e-6b36287b9df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.179876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223e0ed-af44-46b3-b37e-6b36287b9df4 admin admin] PATH_INFO: `/v3/projects/e59a2b2994804f1ebf1028a27ff5d571/users/e5ee404d98fd4b1a84d1e06e7281ddca/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.196004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223e0ed-af44-46b3-b37e-6b36287b9df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59a2b2994804f1ebf1028a27ff5d571, user_id=e5ee404d98fd4b1a84d1e06e7281ddca, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:30.199162 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223e0ed-af44-46b3-b37e-6b36287b9df4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.213894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1308/2650] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:30 2022] PUT /identity/v3/projects/e59a2b2994804f1ebf1028a27ff5d571/users/e5ee404d98fd4b1a84d1e06e7281ddca/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:30.217766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223e0ed-af44-46b3-b37e-6b36287b9df4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.227067 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0767a6d9a61d4d2aa1ed6d845ba9d850'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.227850 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0767a6d9a61d4d2aa1ed6d845ba9d850'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.240359 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0767a6d9a61d4d2aa1ed6d845ba9d850'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.241029 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0767a6d9a61d4d2aa1ed6d845ba9d850'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.247872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dba151c9-cc57-4d19-baad-17fc7ad59f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0767a6d9a61d4d2aa1ed6d845ba9d850'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.260315 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1343/2651] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:30 2022] DELETE /identity/v3/users/0767a6d9a61d4d2aa1ed6d845ba9d850 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:30.264655 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170c79-967b-4ad5-8849-f075a06f755a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.264945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170c79-967b-4ad5-8849-f075a06f755a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.265228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170c79-967b-4ad5-8849-f075a06f755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.279590 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223e0ed-af44-46b3-b37e-6b36287b9df4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:30.282507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c2170c79-967b-4ad5-8849-f075a06f755a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:30.283741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c2170c79-967b-4ad5-8849-f075a06f755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:30.340159 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1c1d2-c324-4e20-9e42-e5496a480c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:30.340940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1c1d2-c324-4e20-9e42-e5496a480c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.341282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1c1d2-c324-4e20-9e42-e5496a480c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.341694 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1c1d2-c324-4e20-9e42-e5496a480c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.342424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1c1d2-c324-4e20-9e42-e5496a480c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:30.344015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1c1d2-c324-4e20-9e42-e5496a480c95 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.346373 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1344/2652] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:30.355132 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1309/2653] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:30.356828 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170c79-967b-4ad5-8849-f075a06f755a None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.358310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c2170c79-967b-4ad5-8849-f075a06f755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:30.358833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1c1d2-c324-4e20-9e42-e5496a480c95 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.360542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-84f1c1d2-c324-4e20-9e42-e5496a480c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:30.373189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1c1d2-c324-4e20-9e42-e5496a480c95 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:30.377854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d52702-09c4-4c64-91cd-3e3c7ae3c034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:30.378717 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d52702-09c4-4c64-91cd-3e3c7ae3c034 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.379004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d52702-09c4-4c64-91cd-3e3c7ae3c034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.379283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d52702-09c4-4c64-91cd-3e3c7ae3c034 admin admin] PATH_INFO: `/v3/projects/e59a2b2994804f1ebf1028a27ff5d571/users/e5ee404d98fd4b1a84d1e06e7281ddca/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.381283 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d52702-09c4-4c64-91cd-3e3c7ae3c034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59a2b2994804f1ebf1028a27ff5d571, user_id=e5ee404d98fd4b1a84d1e06e7281ddca, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:30.383967 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d52702-09c4-4c64-91cd-3e3c7ae3c034 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.404710 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1310/2654] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:30 2022] PUT /identity/v3/projects/e59a2b2994804f1ebf1028a27ff5d571/users/e5ee404d98fd4b1a84d1e06e7281ddca/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:30.416034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da782c74-2f21-4578-8a5f-80837779cbb8 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.416395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da782c74-2f21-4578-8a5f-80837779cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.416689 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da782c74-2f21-4578-8a5f-80837779cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.419456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170c79-967b-4ad5-8849-f075a06f755a None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:30.444147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-da782c74-2f21-4578-8a5f-80837779cbb8 None None] MFA Rules not processed for user `e5ee404d98fd4b1a84d1e06e7281ddca`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:30.445381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-da782c74-2f21-4578-8a5f-80837779cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:30.473270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681460c9-34f6-4acf-a687-ab742f14b1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:30.473947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681460c9-34f6-4acf-a687-ab742f14b1de service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.474240 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681460c9-34f6-4acf-a687-ab742f14b1de service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.474518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681460c9-34f6-4acf-a687-ab742f14b1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.516973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1311/2655] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:30.528666 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da782c74-2f21-4578-8a5f-80837779cbb8 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.530160 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-da782c74-2f21-4578-8a5f-80837779cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:30.540829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681460c9-34f6-4acf-a687-ab742f14b1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:30.542346 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681460c9-34f6-4acf-a687-ab742f14b1de service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.552405 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1345/2656] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:30.586573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da782c74-2f21-4578-8a5f-80837779cbb8 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:30.590342 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe890fc-0a26-415b-93ba-610f48152e4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:30.591016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe890fc-0a26-415b-93ba-610f48152e4c service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.591302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe890fc-0a26-415b-93ba-610f48152e4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.591583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe890fc-0a26-415b-93ba-610f48152e4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.601095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe890fc-0a26-415b-93ba-610f48152e4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:30.602637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe890fc-0a26-415b-93ba-610f48152e4c service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.613067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1312/2657] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:06:30.843298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681460c9-34f6-4acf-a687-ab742f14b1de service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.844841 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-681460c9-34f6-4acf-a687-ab742f14b1de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:30.857558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681460c9-34f6-4acf-a687-ab742f14b1de service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:30.862379 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:30.863249 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:30.863528 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:30.863798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] PATH_INFO: `/v3/projects/301fe21ed41349a0a490a732d588317e` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:30.865114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=301fe21ed41349a0a490a732d588317e)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:30.867431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:30.917729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301fe21ed41349a0a490a732d588317e', 'request_id': 'req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.926121 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301fe21ed41349a0a490a732d588317e', 'request_id': 'req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.933257 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301fe21ed41349a0a490a732d588317e', 'request_id': 'req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.944479 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] The token cache is being invalidate because project 301fe21ed41349a0a490a732d588317e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:30.944770 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.945742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:30.947651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1346/2658] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:30 2022] DELETE /identity/v3/projects/301fe21ed41349a0a490a732d588317e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:30.951376 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe890fc-0a26-415b-93ba-610f48152e4c service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:30.964129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe890fc-0a26-415b-93ba-610f48152e4c service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:31.041038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:31.042032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:31.042318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:31.042626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] PATH_INFO: `/v3/users/a9a0cc8ef9144453967ed1782119afe7` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:31.043838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a0cc8ef9144453967ed1782119afe7)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:31.045790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:31.104417 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a0cc8ef9144453967ed1782119afe7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.117785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a0cc8ef9144453967ed1782119afe7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.125074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a0cc8ef9144453967ed1782119afe7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.125842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a0cc8ef9144453967ed1782119afe7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.135809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-8ab5ac80-1087-499a-bc81-2f671be5a8ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a0cc8ef9144453967ed1782119afe7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.143723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1313/2659] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:30 2022] DELETE /identity/v3/users/a9a0cc8ef9144453967ed1782119afe7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:31.248604 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:31.250219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:31.263565 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206dc03-8b56-4915-a2c9-fc734f9b8b0b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:31.327878 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:31.328785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:31.329099 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:31.329375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] PATH_INFO: `/v3/users/2b27f98639e5491a9cf67c2e333b5df5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:31.331481 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b27f98639e5491a9cf67c2e333b5df5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:31.335698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:31.399964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b27f98639e5491a9cf67c2e333b5df5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.400721 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b27f98639e5491a9cf67c2e333b5df5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.415796 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b27f98639e5491a9cf67c2e333b5df5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.416597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b27f98639e5491a9cf67c2e333b5df5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.427458 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b27f98639e5491a9cf67c2e333b5df5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.441103 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1347/2660] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:31 2022] DELETE /identity/v3/users/2b27f98639e5491a9cf67c2e333b5df5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:31.446410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977a5d-591d-4daf-9ac8-1dbe172095ff None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:31.447051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977a5d-591d-4daf-9ac8-1dbe172095ff None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:31.447544 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977a5d-591d-4daf-9ac8-1dbe172095ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:31.466284 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0e977a5d-591d-4daf-9ac8-1dbe172095ff None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:31.470038 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0e977a5d-591d-4daf-9ac8-1dbe172095ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:31.548512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1314/2661] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:31.549677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:31.551902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:31.566554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977a5d-591d-4daf-9ac8-1dbe172095ff None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:31.568906 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0e977a5d-591d-4daf-9ac8-1dbe172095ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:31.570345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628af72-b291-45c0-9caa-82868a008107 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:31.576343 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:31.577351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:31.577698 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:31.577980 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] PATH_INFO: `/v3/users/4afe3e5522534562ad835af83b830ab9` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:31.579203 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afe3e5522534562ad835af83b830ab9)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:31.581704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:31.638903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977a5d-591d-4daf-9ac8-1dbe172095ff None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:31.641153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afe3e5522534562ad835af83b830ab9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.642058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afe3e5522534562ad835af83b830ab9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.643275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d542-0317-430b-9c82-53295a92ac54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:31.643911 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d542-0317-430b-9c82-53295a92ac54 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:31.644202 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d542-0317-430b-9c82-53295a92ac54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:31.644480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d542-0317-430b-9c82-53295a92ac54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:31.655092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d542-0317-430b-9c82-53295a92ac54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:31.656291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afe3e5522534562ad835af83b830ab9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.656556 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d542-0317-430b-9c82-53295a92ac54 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:31.657055 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afe3e5522534562ad835af83b830ab9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.665738 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afe3e5522534562ad835af83b830ab9'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.667214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1315/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:31.679365 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1348/2663] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:31 2022] DELETE /identity/v3/users/4afe3e5522534562ad835af83b830ab9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:31.766286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d542-0317-430b-9c82-53295a92ac54 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:31.768021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-35a9d542-0317-430b-9c82-53295a92ac54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:31.782933 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d542-0317-430b-9c82-53295a92ac54 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:31.885514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:31.890287 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:31.903548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:31.904614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:31.904997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:31.905402 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] PATH_INFO: `/v3/projects/1025124f6caa48a9854a6f965deb7579` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:31.906779 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1025124f6caa48a9854a6f965deb7579)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:31.908842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:31.976517 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1025124f6caa48a9854a6f965deb7579', 'request_id': 'req-a609b3b5-b640-41cd-9ee9-ff5a85076907'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.983666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be205010-4ccb-4d17-afed-46e271511d0f admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:31.984382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1025124f6caa48a9854a6f965deb7579', 'request_id': 'req-a609b3b5-b640-41cd-9ee9-ff5a85076907'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:31.991089 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1025124f6caa48a9854a6f965deb7579', 'request_id': 'req-a609b3b5-b640-41cd-9ee9-ff5a85076907'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.002734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] The token cache is being invalidate because project 1025124f6caa48a9854a6f965deb7579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:32.008575 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.009798 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-a609b3b5-b640-41cd-9ee9-ff5a85076907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.012395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1316/2664] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:31 2022] DELETE /identity/v3/projects/1025124f6caa48a9854a6f965deb7579 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:32.017310 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30b12-596f-4c68-89d8-3e0ac833ba31 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.017640 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30b12-596f-4c68-89d8-3e0ac833ba31 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.017928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30b12-596f-4c68-89d8-3e0ac833ba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.045002 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8de30b12-596f-4c68-89d8-3e0ac833ba31 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:32.046761 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8de30b12-596f-4c68-89d8-3e0ac833ba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.053242 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.054182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.054467 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.054915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] PATH_INFO: `/v3/projects/69299e9979554ba2b07a5e29d1b792b8` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.056398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=69299e9979554ba2b07a5e29d1b792b8)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.058380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.105898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69299e9979554ba2b07a5e29d1b792b8', 'request_id': 'req-dd839296-41ea-4def-b9bf-69f7aa314e5c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.110802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1317/2665] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:32.111719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de30b12-596f-4c68-89d8-3e0ac833ba31 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.113493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8de30b12-596f-4c68-89d8-3e0ac833ba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.117950 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69299e9979554ba2b07a5e29d1b792b8', 'request_id': 'req-dd839296-41ea-4def-b9bf-69f7aa314e5c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.126993 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69299e9979554ba2b07a5e29d1b792b8', 'request_id': 'req-dd839296-41ea-4def-b9bf-69f7aa314e5c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.137081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de30b12-596f-4c68-89d8-3e0ac833ba31 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.140189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] The token cache is being invalidate because project 69299e9979554ba2b07a5e29d1b792b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:32.140477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.141146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-dd839296-41ea-4def-b9bf-69f7aa314e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.142709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1349/2666] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:31 2022] DELETE /identity/v3/projects/69299e9979554ba2b07a5e29d1b792b8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:32.146273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae7ce3-278e-4675-a307-3afe5466897a None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.146273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae7ce3-278e-4675-a307-3afe5466897a None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.146273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae7ce3-278e-4675-a307-3afe5466897a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.161912 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-0fae7ce3-278e-4675-a307-3afe5466897a None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:32.163104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0fae7ce3-278e-4675-a307-3afe5466897a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.194635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.195495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.195772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.196045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] PATH_INFO: `/v3/projects/1713816a54e34a57838670fb53c891bf` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.197243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1713816a54e34a57838670fb53c891bf)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.199658 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.220899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1350/2667] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:32.222219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b732fa3-1992-4902-b378-afa0dfe64432 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.222502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b732fa3-1992-4902-b378-afa0dfe64432 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.222782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b732fa3-1992-4902-b378-afa0dfe64432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.242444 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-1b732fa3-1992-4902-b378-afa0dfe64432 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:32.244180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1b732fa3-1992-4902-b378-afa0dfe64432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.249455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1713816a54e34a57838670fb53c891bf', 'request_id': 'req-5a102eec-cc7a-44ae-8d86-48991e1e3475'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.258462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1713816a54e34a57838670fb53c891bf', 'request_id': 'req-5a102eec-cc7a-44ae-8d86-48991e1e3475'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.264025 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1713816a54e34a57838670fb53c891bf', 'request_id': 'req-5a102eec-cc7a-44ae-8d86-48991e1e3475'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.275396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] The token cache is being invalidate because project 1713816a54e34a57838670fb53c891bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:32.275684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.276339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.278188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1318/2668] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:32 2022] DELETE /identity/v3/projects/1713816a54e34a57838670fb53c891bf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:32.281121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.281121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.311962 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1351/2669] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:32.314404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b732fa3-1992-4902-b378-afa0dfe64432 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.315904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1b732fa3-1992-4902-b378-afa0dfe64432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.328465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b732fa3-1992-4902-b378-afa0dfe64432 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.333697 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.334571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.334836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.335143 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] PATH_INFO: `/v3/users/e5ee404d98fd4b1a84d1e06e7281ddca` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.336313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ee404d98fd4b1a84d1e06e7281ddca)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.338278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.342842 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a102eec-cc7a-44ae-8d86-48991e1e3475 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.347489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db96cf0-92d0-436e-b262-9576a19ec0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.348184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db96cf0-92d0-436e-b262-9576a19ec0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.348467 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db96cf0-92d0-436e-b262-9576a19ec0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.348742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db96cf0-92d0-436e-b262-9576a19ec0d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.349472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db96cf0-92d0-436e-b262-9576a19ec0d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:32.349810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db96cf0-92d0-436e-b262-9576a19ec0d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.351395 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db96cf0-92d0-436e-b262-9576a19ec0d5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.364949 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1319/2670] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:06:32.366888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91c14d-578a-4604-b414-f8c7219a4efd None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.367176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91c14d-578a-4604-b414-f8c7219a4efd None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.367464 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91c14d-578a-4604-b414-f8c7219a4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.390646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0c91c14d-578a-4604-b414-f8c7219a4efd None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:32.391864 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0c91c14d-578a-4604-b414-f8c7219a4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.397296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ee404d98fd4b1a84d1e06e7281ddca'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.397960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ee404d98fd4b1a84d1e06e7281ddca'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.400618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1320/2671] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:32.401388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91c14d-578a-4604-b414-f8c7219a4efd None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.410907 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ee404d98fd4b1a84d1e06e7281ddca'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.411414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91c14d-578a-4604-b414-f8c7219a4efd None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.411607 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ee404d98fd4b1a84d1e06e7281ddca'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.416062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd719a43-2333-4c63-89f0-dd722bae24a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.416832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd719a43-2333-4c63-89f0-dd722bae24a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.417033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd719a43-2333-4c63-89f0-dd722bae24a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.417312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd719a43-2333-4c63-89f0-dd722bae24a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.418120 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd719a43-2333-4c63-89f0-dd722bae24a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.419239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ee404d98fd4b1a84d1e06e7281ddca'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.420097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd719a43-2333-4c63-89f0-dd722bae24a3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.431375 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1352/2672] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:32 2022] DELETE /identity/v3/users/e5ee404d98fd4b1a84d1e06e7281ddca => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:32.432189 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.433505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.446209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1321/2673] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:32 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:32.450355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd719a43-2333-4c63-89f0-dd722bae24a3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.452423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dd719a43-2333-4c63-89f0-dd722bae24a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.511672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870029a-9f48-4e51-bcc1-ebe4df60b354 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.517073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3122f0-39b8-4367-8beb-f3a4c5528537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.517908 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3122f0-39b8-4367-8beb-f3a4c5528537 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.518192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3122f0-39b8-4367-8beb-f3a4c5528537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.519387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3122f0-39b8-4367-8beb-f3a4c5528537 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.520183 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3122f0-39b8-4367-8beb-f3a4c5528537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:32.520992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3122f0-39b8-4367-8beb-f3a4c5528537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.522654 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3122f0-39b8-4367-8beb-f3a4c5528537 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.523021 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd719a43-2333-4c63-89f0-dd722bae24a3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.531563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bfbe8-a5bf-4401-8a2c-d3632d9c52be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.532272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bfbe8-a5bf-4401-8a2c-d3632d9c52be admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.532557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bfbe8-a5bf-4401-8a2c-d3632d9c52be admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.532832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bfbe8-a5bf-4401-8a2c-d3632d9c52be admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.533559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bfbe8-a5bf-4401-8a2c-d3632d9c52be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.535936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1353/2674] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:06:32.536239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bfbe8-a5bf-4401-8a2c-d3632d9c52be admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.539898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3122f0-39b8-4367-8beb-f3a4c5528537 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.551341 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3122f0-39b8-4367-8beb-f3a4c5528537 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.557117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bde31b-e212-48b7-bb86-a1d35fc87d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.557801 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bde31b-e212-48b7-bb86-a1d35fc87d78 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.558136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bde31b-e212-48b7-bb86-a1d35fc87d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.558317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1322/2675] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:32 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:32.558693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bde31b-e212-48b7-bb86-a1d35fc87d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.559378 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bde31b-e212-48b7-bb86-a1d35fc87d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.561322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bde31b-e212-48b7-bb86-a1d35fc87d78 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.562747 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bfbe8-a5bf-4401-8a2c-d3632d9c52be admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.573178 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bfbe8-a5bf-4401-8a2c-d3632d9c52be admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.578091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aacdd-b030-415a-af13-1d605e60c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.578783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aacdd-b030-415a-af13-1d605e60c3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.579061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aacdd-b030-415a-af13-1d605e60c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.579339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aacdd-b030-415a-af13-1d605e60c3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.580059 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242aacdd-b030-415a-af13-1d605e60c3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.581766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242aacdd-b030-415a-af13-1d605e60c3e9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.594260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1323/2676] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:32.600299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aacdd-b030-415a-af13-1d605e60c3e9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.608351 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1354/2677] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:32 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:32.612095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aacdd-b030-415a-af13-1d605e60c3e9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.615484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bde31b-e212-48b7-bb86-a1d35fc87d78 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.681401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5449e0-fb3d-49c3-95b5-c9f6b67854f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.682297 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5449e0-fb3d-49c3-95b5-c9f6b67854f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.682573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5449e0-fb3d-49c3-95b5-c9f6b67854f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.682912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5449e0-fb3d-49c3-95b5-c9f6b67854f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.683561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bde31b-e212-48b7-bb86-a1d35fc87d78 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.683834 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5449e0-fb3d-49c3-95b5-c9f6b67854f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.685687 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5449e0-fb3d-49c3-95b5-c9f6b67854f3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.687984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b598-5ad9-4a6a-affa-fd7f10a529e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.688875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b598-5ad9-4a6a-affa-fd7f10a529e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.688998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b598-5ad9-4a6a-affa-fd7f10a529e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.689502 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b598-5ad9-4a6a-affa-fd7f10a529e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.690229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2b598-5ad9-4a6a-affa-fd7f10a529e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.692772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2b598-5ad9-4a6a-affa-fd7f10a529e3 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.698095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1324/2678] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:06:32.702191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5449e0-fb3d-49c3-95b5-c9f6b67854f3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.713996 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5449e0-fb3d-49c3-95b5-c9f6b67854f3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.716300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1355/2679] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:32 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:32.718802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a401be3-7f81-4bda-a859-148ebc03f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.719752 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a401be3-7f81-4bda-a859-148ebc03f0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.720093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a401be3-7f81-4bda-a859-148ebc03f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.720393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b598-5ad9-4a6a-affa-fd7f10a529e3 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.720520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a401be3-7f81-4bda-a859-148ebc03f0c4 admin admin] PATH_INFO: `/v3/projects/67b74493f21f4a15bc1f216dc41d516b/users/3590f48f106e4d3a98e22a5544c8f4d3/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.741692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a401be3-7f81-4bda-a859-148ebc03f0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b74493f21f4a15bc1f216dc41d516b, user_id=3590f48f106e4d3a98e22a5544c8f4d3, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.743973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b598-5ad9-4a6a-affa-fd7f10a529e3 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.744737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a401be3-7f81-4bda-a859-148ebc03f0c4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.749485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de9fea-1272-4b8f-8d2b-d8aa657efa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.750521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de9fea-1272-4b8f-8d2b-d8aa657efa35 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.751002 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de9fea-1272-4b8f-8d2b-d8aa657efa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.751501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de9fea-1272-4b8f-8d2b-d8aa657efa35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.752254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de9fea-1272-4b8f-8d2b-d8aa657efa35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.754142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de9fea-1272-4b8f-8d2b-d8aa657efa35 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.759210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1325/2680] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:32 2022] PUT /identity/v3/projects/67b74493f21f4a15bc1f216dc41d516b/users/3590f48f106e4d3a98e22a5544c8f4d3/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:32.766734 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a401be3-7f81-4bda-a859-148ebc03f0c4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.768399 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1356/2681] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:06:32.769735 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd10aa-f781-4469-b7c4-31c7c1e9ed50 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.769948 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8a401be3-7f81-4bda-a859-148ebc03f0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.770591 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd10aa-f781-4469-b7c4-31c7c1e9ed50 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.770822 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd10aa-f781-4469-b7c4-31c7c1e9ed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.801787 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-a2fd10aa-f781-4469-b7c4-31c7c1e9ed50 None None] MFA Rules not processed for user `3590f48f106e4d3a98e22a5544c8f4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:32.803089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a2fd10aa-f781-4469-b7c4-31c7c1e9ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.839597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a401be3-7f81-4bda-a859-148ebc03f0c4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.850412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.851490 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.851858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.852142 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] PATH_INFO: `/v3/projects/e59a2b2994804f1ebf1028a27ff5d571` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.853514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59a2b2994804f1ebf1028a27ff5d571)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.856047 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.875026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1357/2682] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:32.875848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd10aa-f781-4469-b7c4-31c7c1e9ed50 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.886264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd10aa-f781-4469-b7c4-31c7c1e9ed50 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:32.891690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500e12-9c83-4aaa-86f8-72f472406d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:32.892353 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500e12-9c83-4aaa-86f8-72f472406d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:32.892641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500e12-9c83-4aaa-86f8-72f472406d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:32.892913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500e12-9c83-4aaa-86f8-72f472406d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:32.893671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500e12-9c83-4aaa-86f8-72f472406d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:32.896083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500e12-9c83-4aaa-86f8-72f472406d29 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:32.907071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1358/2683] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:32.909150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59a2b2994804f1ebf1028a27ff5d571', 'request_id': 'req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.911428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500e12-9c83-4aaa-86f8-72f472406d29 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.914095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-57500e12-9c83-4aaa-86f8-72f472406d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.918513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59a2b2994804f1ebf1028a27ff5d571', 'request_id': 'req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.924489 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59a2b2994804f1ebf1028a27ff5d571', 'request_id': 'req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.938708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] The token cache is being invalidate because project e59a2b2994804f1ebf1028a27ff5d571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:32.938997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.939661 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:32.941210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1326/2684] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:32 2022] DELETE /identity/v3/projects/e59a2b2994804f1ebf1028a27ff5d571 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:32.942013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:32.943614 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:32.976147 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500e12-9c83-4aaa-86f8-72f472406d29 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.011360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91704d9a-ec44-4cd3-9b8e-3c6e5cf71007 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.016092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a2a13-3dc1-4c76-8871-ef508ea3d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.017010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2a13-3dc1-4c76-8871-ef508ea3d2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.017299 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2a13-3dc1-4c76-8871-ef508ea3d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.017638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2a13-3dc1-4c76-8871-ef508ea3d2e6 admin admin] PATH_INFO: `/v3/projects/805ef00e215c4b33b65da357a18eb4bb/users/cbe3491f272248e7a3a8e464c51e23d2/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.026151 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688e5c9-d386-4017-8d5f-95552d733115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.026802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688e5c9-d386-4017-8d5f-95552d733115 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.027083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688e5c9-d386-4017-8d5f-95552d733115 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.027352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688e5c9-d386-4017-8d5f-95552d733115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.029576 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e688e5c9-d386-4017-8d5f-95552d733115 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.033085 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a2a13-3dc1-4c76-8871-ef508ea3d2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805ef00e215c4b33b65da357a18eb4bb, user_id=cbe3491f272248e7a3a8e464c51e23d2, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.036582 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a2a13-3dc1-4c76-8871-ef508ea3d2e6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.054232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1327/2685] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:32 2022] PUT /identity/v3/projects/805ef00e215c4b33b65da357a18eb4bb/users/cbe3491f272248e7a3a8e464c51e23d2/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:33.055594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bec187-c3ba-4e53-8897-b3d5558851c5 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.055891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bec187-c3ba-4e53-8897-b3d5558851c5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.056170 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bec187-c3ba-4e53-8897-b3d5558851c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.082471 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-34bec187-c3ba-4e53-8897-b3d5558851c5 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:33.083775 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-34bec187-c3ba-4e53-8897-b3d5558851c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.104187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688e5c9-d386-4017-8d5f-95552d733115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.105778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688e5c9-d386-4017-8d5f-95552d733115 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.116456 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1359/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:33.120644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358449-ed25-4c17-9c00-12f82c92bc1c None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.121064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358449-ed25-4c17-9c00-12f82c92bc1c None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.121445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358449-ed25-4c17-9c00-12f82c92bc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.153673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-27358449-ed25-4c17-9c00-12f82c92bc1c None None] MFA Rules not processed for user `cbe3491f272248e7a3a8e464c51e23d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:33.154878 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-27358449-ed25-4c17-9c00-12f82c92bc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.161367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1328/2687] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:33.162161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bec187-c3ba-4e53-8897-b3d5558851c5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.163422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-34bec187-c3ba-4e53-8897-b3d5558851c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.175080 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bec187-c3ba-4e53-8897-b3d5558851c5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.179980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.180981 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.187684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.187684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] PATH_INFO: `/v3/users/3590f48f106e4d3a98e22a5544c8f4d3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.188659 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3590f48f106e4d3a98e22a5544c8f4d3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.190837 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.225748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1360/2688] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:33.227191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baaa4c-4ab1-4f1c-9986-995a6cf32f3e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.227487 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baaa4c-4ab1-4f1c-9986-995a6cf32f3e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.227765 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baaa4c-4ab1-4f1c-9986-995a6cf32f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.243530 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3590f48f106e4d3a98e22a5544c8f4d3'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:33.247395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c3baaa4c-4ab1-4f1c-9986-995a6cf32f3e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:33.248622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c3baaa4c-4ab1-4f1c-9986-995a6cf32f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.256885 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3590f48f106e4d3a98e22a5544c8f4d3'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:33.257421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1361/2689] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:33.258300 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baaa4c-4ab1-4f1c-9986-995a6cf32f3e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.259557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c3baaa4c-4ab1-4f1c-9986-995a6cf32f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.264167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3590f48f106e4d3a98e22a5544c8f4d3'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:33.264869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3590f48f106e4d3a98e22a5544c8f4d3'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:33.272845 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3590f48f106e4d3a98e22a5544c8f4d3'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:33.279114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1329/2690] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:33 2022] DELETE /identity/v3/users/3590f48f106e4d3a98e22a5544c8f4d3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:33.279877 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.281255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.319673 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baaa4c-4ab1-4f1c-9986-995a6cf32f3e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.348524 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733b89-0a86-4fe8-9722-8ce5b35cd775 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.353738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845374b6-a0b1-41e7-8944-238aa784f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.354423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845374b6-a0b1-41e7-8944-238aa784f48e admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.354653 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845374b6-a0b1-41e7-8944-238aa784f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.354928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845374b6-a0b1-41e7-8944-238aa784f48e admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.355683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845374b6-a0b1-41e7-8944-238aa784f48e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:33.355987 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845374b6-a0b1-41e7-8944-238aa784f48e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.357597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845374b6-a0b1-41e7-8944-238aa784f48e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.367998 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324a537-5282-44f1-98f5-ba5d5e35e8c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066d62c015e9483e87e4bd64ce8c4df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.368642 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324a537-5282-44f1-98f5-ba5d5e35e8c5 service glance] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.368925 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324a537-5282-44f1-98f5-ba5d5e35e8c5 service glance] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.369201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324a537-5282-44f1-98f5-ba5d5e35e8c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.369977 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1330/2691] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:06:33.370982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c555ff-d6a2-43bc-b89a-9cf67845755e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.371267 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c555ff-d6a2-43bc-b89a-9cf67845755e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.371542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c555ff-d6a2-43bc-b89a-9cf67845755e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.374431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8324a537-5282-44f1-98f5-ba5d5e35e8c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.389000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-51c555ff-d6a2-43bc-b89a-9cf67845755e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:33.390260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-51c555ff-d6a2-43bc-b89a-9cf67845755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.397849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1331/2692] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:33.398577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c555ff-d6a2-43bc-b89a-9cf67845755e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.408554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c555ff-d6a2-43bc-b89a-9cf67845755e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.413944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1276b-e822-48af-9d7f-38562b687ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.414632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1276b-e822-48af-9d7f-38562b687ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.414903 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1276b-e822-48af-9d7f-38562b687ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.415177 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1276b-e822-48af-9d7f-38562b687ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.416185 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1276b-e822-48af-9d7f-38562b687ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.418562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1276b-e822-48af-9d7f-38562b687ba5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.435723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324a537-5282-44f1-98f5-ba5d5e35e8c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.437561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324a537-5282-44f1-98f5-ba5d5e35e8c5 service glance] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.448329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1332/2693] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:33 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:33.448329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1276b-e822-48af-9d7f-38562b687ba5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.448329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-30f1276b-e822-48af-9d7f-38562b687ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.448694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1362/2694] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:33.450019 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324a537-5282-44f1-98f5-ba5d5e35e8c5 service glance] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.460823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324a537-5282-44f1-98f5-ba5d5e35e8c5 service glance] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.513989 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1276b-e822-48af-9d7f-38562b687ba5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.524289 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e007c6-843d-40cb-a855-ec2ffc7709e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.524993 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e007c6-843d-40cb-a855-ec2ffc7709e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.525280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e007c6-843d-40cb-a855-ec2ffc7709e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.525597 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e007c6-843d-40cb-a855-ec2ffc7709e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.528540 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94551c-4894-4ab1-9cb0-55f1bcbc4e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.529347 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94551c-4894-4ab1-9cb0-55f1bcbc4e8c admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.529775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94551c-4894-4ab1-9cb0-55f1bcbc4e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.530144 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94551c-4894-4ab1-9cb0-55f1bcbc4e8c admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.531254 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94551c-4894-4ab1-9cb0-55f1bcbc4e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.536963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94551c-4894-4ab1-9cb0-55f1bcbc4e8c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.541498 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e007c6-843d-40cb-a855-ec2ffc7709e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.542980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e007c6-843d-40cb-a855-ec2ffc7709e6 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.553588 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1333/2695] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:33.559564 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1363/2696] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:33 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:33.563909 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e007c6-843d-40cb-a855-ec2ffc7709e6 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.574488 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e007c6-843d-40cb-a855-ec2ffc7709e6 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.579428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920ecef-3af4-4e0b-8f39-434a28ffb043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.580145 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920ecef-3af4-4e0b-8f39-434a28ffb043 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.580440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920ecef-3af4-4e0b-8f39-434a28ffb043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.580725 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920ecef-3af4-4e0b-8f39-434a28ffb043 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.581459 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920ecef-3af4-4e0b-8f39-434a28ffb043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.583650 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920ecef-3af4-4e0b-8f39-434a28ffb043 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.599348 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1334/2697] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:06:33.603746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94551c-4894-4ab1-9cb0-55f1bcbc4e8c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.615282 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94551c-4894-4ab1-9cb0-55f1bcbc4e8c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.620662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8b3e3-eb87-4ca4-8750-8d528cd840e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.621362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b3e3-eb87-4ca4-8750-8d528cd840e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.621838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b3e3-eb87-4ca4-8750-8d528cd840e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.622051 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b3e3-eb87-4ca4-8750-8d528cd840e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.622951 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8b3e3-eb87-4ca4-8750-8d528cd840e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.624600 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8b3e3-eb87-4ca4-8750-8d528cd840e0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.638130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1364/2698] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:33.642707 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920ecef-3af4-4e0b-8f39-434a28ffb043 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.653149 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920ecef-3af4-4e0b-8f39-434a28ffb043 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.659063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a593a25-89b1-48bb-9a6e-6f382a446cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.660067 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a593a25-89b1-48bb-9a6e-6f382a446cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.660452 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a593a25-89b1-48bb-9a6e-6f382a446cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.660858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a593a25-89b1-48bb-9a6e-6f382a446cbb admin admin] PATH_INFO: `/v3/projects/0e86e4c7808b4fd7be2b892d43bdbce4/users/84b6762c36034bed9ae90a27792eaa58/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.679178 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a593a25-89b1-48bb-9a6e-6f382a446cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e86e4c7808b4fd7be2b892d43bdbce4, user_id=84b6762c36034bed9ae90a27792eaa58, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.682213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a593a25-89b1-48bb-9a6e-6f382a446cbb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.699274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1335/2699] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:33 2022] PUT /identity/v3/projects/0e86e4c7808b4fd7be2b892d43bdbce4/users/84b6762c36034bed9ae90a27792eaa58/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:33.711888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b85f-9caa-4d01-9082-e646693c6e1e None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.711888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b85f-9caa-4d01-9082-e646693c6e1e None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.711888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b85f-9caa-4d01-9082-e646693c6e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.754279 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-3ec1b85f-9caa-4d01-9082-e646693c6e1e None None] MFA Rules not processed for user `84b6762c36034bed9ae90a27792eaa58`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:33.755928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3ec1b85f-9caa-4d01-9082-e646693c6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:33.830201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1365/2700] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:33.835046 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a593a25-89b1-48bb-9a6e-6f382a446cbb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.912684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a593a25-89b1-48bb-9a6e-6f382a446cbb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:33.918084 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862f077-d4b7-4140-a554-4925bb836335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:33.919097 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862f077-d4b7-4140-a554-4925bb836335 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:33.919482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862f077-d4b7-4140-a554-4925bb836335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:33.919872 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862f077-d4b7-4140-a554-4925bb836335 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:33.921061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862f077-d4b7-4140-a554-4925bb836335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:33.923948 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862f077-d4b7-4140-a554-4925bb836335 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:33.976406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1336/2701] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:33 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:33.977572 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b85f-9caa-4d01-9082-e646693c6e1e None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:33.994332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b85f-9caa-4d01-9082-e646693c6e1e None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.064753 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc2392-5fca-4d9b-97fa-a4903bc3e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.065561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc2392-5fca-4d9b-97fa-a4903bc3e5ae admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.065904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc2392-5fca-4d9b-97fa-a4903bc3e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.066235 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc2392-5fca-4d9b-97fa-a4903bc3e5ae admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.067470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc2392-5fca-4d9b-97fa-a4903bc3e5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.069432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc2392-5fca-4d9b-97fa-a4903bc3e5ae admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.090494 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1366/2702] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:33 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:34.094106 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862f077-d4b7-4140-a554-4925bb836335 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.105278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862f077-d4b7-4140-a554-4925bb836335 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.110513 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d86bc5-ab7f-421e-af16-288b05343f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.111256 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d86bc5-ab7f-421e-af16-288b05343f28 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.111543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d86bc5-ab7f-421e-af16-288b05343f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.111812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d86bc5-ab7f-421e-af16-288b05343f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.112534 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d86bc5-ab7f-421e-af16-288b05343f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.114669 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d86bc5-ab7f-421e-af16-288b05343f28 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.126957 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1337/2703] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:34.131761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc2392-5fca-4d9b-97fa-a4903bc3e5ae admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.142142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc2392-5fca-4d9b-97fa-a4903bc3e5ae admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.147154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3481c-0026-4775-866c-d5e5f09114d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.148089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3481c-0026-4775-866c-d5e5f09114d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.148439 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3481c-0026-4775-866c-d5e5f09114d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.148782 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3481c-0026-4775-866c-d5e5f09114d6 admin admin] PATH_INFO: `/v3/projects/223b20427c1f45e98cc446de9f269db9/users/96c82fa303374a24ba5243b74a219404/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.163763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3481c-0026-4775-866c-d5e5f09114d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223b20427c1f45e98cc446de9f269db9, user_id=96c82fa303374a24ba5243b74a219404, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.169945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3481c-0026-4775-866c-d5e5f09114d6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.179915 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1367/2704] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:34 2022] PUT /identity/v3/projects/223b20427c1f45e98cc446de9f269db9/users/96c82fa303374a24ba5243b74a219404/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:34.184151 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d86bc5-ab7f-421e-af16-288b05343f28 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.198756 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3481c-0026-4775-866c-d5e5f09114d6 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.200506 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-88c3481c-0026-4775-866c-d5e5f09114d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:34.202068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d86bc5-ab7f-421e-af16-288b05343f28 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.271091 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3481c-0026-4775-866c-d5e5f09114d6 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.276063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.276945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.277230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.277552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] PATH_INFO: `/v3/projects/67b74493f21f4a15bc1f216dc41d516b` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.279109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b74493f21f4a15bc1f216dc41d516b)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.281043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.282724 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a0467-f383-48cd-ae87-0880c1190c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.283444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a0467-f383-48cd-ae87-0880c1190c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.283677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a0467-f383-48cd-ae87-0880c1190c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.283953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a0467-f383-48cd-ae87-0880c1190c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.284726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a0467-f383-48cd-ae87-0880c1190c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.286413 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a0467-f383-48cd-ae87-0880c1190c94 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.299216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1338/2705] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:06:34.300200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a0467-f383-48cd-ae87-0880c1190c94 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.310253 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a0467-f383-48cd-ae87-0880c1190c94 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.314944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592024-1311-4ecd-9c2b-916cbbe2699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.315879 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592024-1311-4ecd-9c2b-916cbbe2699a admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.316229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592024-1311-4ecd-9c2b-916cbbe2699a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.316512 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592024-1311-4ecd-9c2b-916cbbe2699a admin admin] PATH_INFO: `/v3/projects/223b20427c1f45e98cc446de9f269db9/users/96c82fa303374a24ba5243b74a219404/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.319156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f592024-1311-4ecd-9c2b-916cbbe2699a admin admin] RBAC: Authorizing `identity:create_grant(project_id=223b20427c1f45e98cc446de9f269db9, user_id=96c82fa303374a24ba5243b74a219404, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.321793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f592024-1311-4ecd-9c2b-916cbbe2699a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.327484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b74493f21f4a15bc1f216dc41d516b', 'request_id': 'req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:34.332374 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1339/2706] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:34 2022] PUT /identity/v3/projects/223b20427c1f45e98cc446de9f269db9/users/96c82fa303374a24ba5243b74a219404/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:34.343237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b74493f21f4a15bc1f216dc41d516b', 'request_id': 'req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:34.344772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42fba4-e0f8-4383-9cf5-98cb01480168 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.345073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42fba4-e0f8-4383-9cf5-98cb01480168 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.345363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42fba4-e0f8-4383-9cf5-98cb01480168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.351307 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b74493f21f4a15bc1f216dc41d516b', 'request_id': 'req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:34.365106 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] The token cache is being invalidate because project 67b74493f21f4a15bc1f216dc41d516b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:34.365569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:34.366597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-76ef1d62-20b8-4a3f-b776-cfb3b68693ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:34.372273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1368/2707] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:34 2022] DELETE /identity/v3/projects/67b74493f21f4a15bc1f216dc41d516b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:34.373892 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0043b0-5198-4fbe-9b3b-65d7ab6794c7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.374186 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0043b0-5198-4fbe-9b3b-65d7ab6794c7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.376119 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0043b0-5198-4fbe-9b3b-65d7ab6794c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.383683 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-8a42fba4-e0f8-4383-9cf5-98cb01480168 None None] MFA Rules not processed for user `96c82fa303374a24ba5243b74a219404`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:34.384927 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8a42fba4-e0f8-4383-9cf5-98cb01480168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:34.398050 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-3b0043b0-5198-4fbe-9b3b-65d7ab6794c7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:34.399301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3b0043b0-5198-4fbe-9b3b-65d7ab6794c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:34.456557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1340/2708] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:34.463492 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1369/2709] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:34.470024 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42fba4-e0f8-4383-9cf5-98cb01480168 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.471052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960ad4c-6423-4348-afbb-dd3cc17f2343 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.471345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960ad4c-6423-4348-afbb-dd3cc17f2343 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.471449 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8a42fba4-e0f8-4383-9cf5-98cb01480168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:34.471623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960ad4c-6423-4348-afbb-dd3cc17f2343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.490063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-a960ad4c-6423-4348-afbb-dd3cc17f2343 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:34.491278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a960ad4c-6423-4348-afbb-dd3cc17f2343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:34.499364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1370/2710] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:34.503312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960ad4c-6423-4348-afbb-dd3cc17f2343 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.514637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960ad4c-6423-4348-afbb-dd3cc17f2343 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.527566 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f311d-fd0a-46c9-8cbf-55c01280271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.528586 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f311d-fd0a-46c9-8cbf-55c01280271b admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.529773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f311d-fd0a-46c9-8cbf-55c01280271b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.529773 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f311d-fd0a-46c9-8cbf-55c01280271b admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.529984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f311d-fd0a-46c9-8cbf-55c01280271b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:34.530288 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f311d-fd0a-46c9-8cbf-55c01280271b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.532204 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f311d-fd0a-46c9-8cbf-55c01280271b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.536580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42fba4-e0f8-4383-9cf5-98cb01480168 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.540360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ddfe8-619a-41c4-868b-a9806f84b44b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.541012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ddfe8-619a-41c4-868b-a9806f84b44b service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.541295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ddfe8-619a-41c4-868b-a9806f84b44b service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.541604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ddfe8-619a-41c4-868b-a9806f84b44b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.544557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1371/2711] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:06:34.553559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f311d-fd0a-46c9-8cbf-55c01280271b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.553770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ddfe8-619a-41c4-868b-a9806f84b44b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.554332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ddfe8-619a-41c4-868b-a9806f84b44b service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.563318 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f311d-fd0a-46c9-8cbf-55c01280271b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.564423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1341/2712] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:06:34.568891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fa6e7-44bd-4e1c-b70e-abf1ffc64bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.569582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fa6e7-44bd-4e1c-b70e-abf1ffc64bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.569875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fa6e7-44bd-4e1c-b70e-abf1ffc64bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.570153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fa6e7-44bd-4e1c-b70e-abf1ffc64bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.570842 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fa6e7-44bd-4e1c-b70e-abf1ffc64bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.572861 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fa6e7-44bd-4e1c-b70e-abf1ffc64bf2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.601783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1372/2713] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:34 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:34.605628 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ddfe8-619a-41c4-868b-a9806f84b44b service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.616274 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ddfe8-619a-41c4-868b-a9806f84b44b service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.641938 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fa6e7-44bd-4e1c-b70e-abf1ffc64bf2 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.676771 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e55b4e-1a35-4e1b-a44c-16a5fc1f912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.677774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e55b4e-1a35-4e1b-a44c-16a5fc1f912b admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.678068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e55b4e-1a35-4e1b-a44c-16a5fc1f912b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.678345 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e55b4e-1a35-4e1b-a44c-16a5fc1f912b admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.679054 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e55b4e-1a35-4e1b-a44c-16a5fc1f912b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.681072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e55b4e-1a35-4e1b-a44c-16a5fc1f912b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.701638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1342/2714] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:34 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:34.702711 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fa6e7-44bd-4e1c-b70e-abf1ffc64bf2 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.705619 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e55b4e-1a35-4e1b-a44c-16a5fc1f912b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.706465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedcf4e-d797-4016-9a51-b73d2820dc18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.707101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedcf4e-d797-4016-9a51-b73d2820dc18 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.707417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedcf4e-d797-4016-9a51-b73d2820dc18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.707690 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedcf4e-d797-4016-9a51-b73d2820dc18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.709482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3eedcf4e-d797-4016-9a51-b73d2820dc18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:34.715257 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e55b4e-1a35-4e1b-a44c-16a5fc1f912b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.720010 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bd2d8-181d-44be-b75b-c1ca82223e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.720652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bd2d8-181d-44be-b75b-c1ca82223e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.720943 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bd2d8-181d-44be-b75b-c1ca82223e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.721225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bd2d8-181d-44be-b75b-c1ca82223e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.722092 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bd2d8-181d-44be-b75b-c1ca82223e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.724708 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bd2d8-181d-44be-b75b-c1ca82223e24 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.743373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1343/2715] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:34.747635 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bd2d8-181d-44be-b75b-c1ca82223e24 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.757612 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bd2d8-181d-44be-b75b-c1ca82223e24 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.763050 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de7f60-d310-43eb-8736-d73c57fee4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.763920 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de7f60-d310-43eb-8736-d73c57fee4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.764211 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de7f60-d310-43eb-8736-d73c57fee4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.764497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de7f60-d310-43eb-8736-d73c57fee4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.765352 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de7f60-d310-43eb-8736-d73c57fee4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.767499 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de7f60-d310-43eb-8736-d73c57fee4a3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.779066 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1344/2716] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:34.783056 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de7f60-d310-43eb-8736-d73c57fee4a3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.785035 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedcf4e-d797-4016-9a51-b73d2820dc18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.787077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedcf4e-d797-4016-9a51-b73d2820dc18 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.792960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de7f60-d310-43eb-8736-d73c57fee4a3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:34.795975 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1373/2717] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:06:34.797716 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aae1e-69b8-486e-b53f-fdc3b03eb585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:34.798574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aae1e-69b8-486e-b53f-fdc3b03eb585 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.798861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aae1e-69b8-486e-b53f-fdc3b03eb585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.799136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aae1e-69b8-486e-b53f-fdc3b03eb585 admin admin] PATH_INFO: `/v3/projects/3ff6e876f1ec44939bebef28b7dac12b/users/9e68f1722227477cbbacd4813cd4f4bc/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.814096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aae1e-69b8-486e-b53f-fdc3b03eb585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff6e876f1ec44939bebef28b7dac12b, user_id=9e68f1722227477cbbacd4813cd4f4bc, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:34.816818 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aae1e-69b8-486e-b53f-fdc3b03eb585 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:34.834163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1345/2718] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:34 2022] PUT /identity/v3/projects/3ff6e876f1ec44939bebef28b7dac12b/users/9e68f1722227477cbbacd4813cd4f4bc/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:34.839837 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285353fc-74f0-4269-b204-c60ba9efd0da None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:34.840158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285353fc-74f0-4269-b204-c60ba9efd0da None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:34.840702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285353fc-74f0-4269-b204-c60ba9efd0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:34.860212 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-285353fc-74f0-4269-b204-c60ba9efd0da None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:34.861434 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-285353fc-74f0-4269-b204-c60ba9efd0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:34.924076 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1374/2719] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:34.935643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aae1e-69b8-486e-b53f-fdc3b03eb585 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:34.937642 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-c75aae1e-69b8-486e-b53f-fdc3b03eb585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:35.029090 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aae1e-69b8-486e-b53f-fdc3b03eb585 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:35.047248 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92502c3b-5d7c-4472-873b-cfac98bf07e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:35.047944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92502c3b-5d7c-4472-873b-cfac98bf07e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:35.048229 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92502c3b-5d7c-4472-873b-cfac98bf07e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:35.048509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92502c3b-5d7c-4472-873b-cfac98bf07e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:35.058412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92502c3b-5d7c-4472-873b-cfac98bf07e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:35.059853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92502c3b-5d7c-4472-873b-cfac98bf07e1 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:35.069286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1346/2720] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:35.103011 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285353fc-74f0-4269-b204-c60ba9efd0da None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:35.104407 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-285353fc-74f0-4269-b204-c60ba9efd0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:35.116386 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285353fc-74f0-4269-b204-c60ba9efd0da None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:35.128003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:35.128829 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:35.129102 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:35.129433 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] PATH_INFO: `/v3/users/84b6762c36034bed9ae90a27792eaa58` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:35.130860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b6762c36034bed9ae90a27792eaa58)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:35.132656 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:35.188030 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b6762c36034bed9ae90a27792eaa58'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.188901 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b6762c36034bed9ae90a27792eaa58'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.201216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b6762c36034bed9ae90a27792eaa58'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.201931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b6762c36034bed9ae90a27792eaa58'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.209983 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b6762c36034bed9ae90a27792eaa58'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.223957 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1375/2721] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:35 2022] DELETE /identity/v3/users/84b6762c36034bed9ae90a27792eaa58 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:35.228866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d82e-f675-483d-ab61-1312b45dc472 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:35.229854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d82e-f675-483d-ab61-1312b45dc472 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:35.230171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d82e-f675-483d-ab61-1312b45dc472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:35.249494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-00a4d82e-f675-483d-ab61-1312b45dc472 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:35.250813 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00a4d82e-f675-483d-ab61-1312b45dc472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:35.325039 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1347/2722] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:35.335325 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:35.336918 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:35.397557 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf41790-e3d3-4b5c-922e-512ae20f12ad admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:35.401251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3302a84-c988-453c-bd01-1ad80b6b4659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:35.401926 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302a84-c988-453c-bd01-1ad80b6b4659 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:35.402213 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302a84-c988-453c-bd01-1ad80b6b4659 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:35.402491 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302a84-c988-453c-bd01-1ad80b6b4659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:35.412071 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3302a84-c988-453c-bd01-1ad80b6b4659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:35.413545 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3302a84-c988-453c-bd01-1ad80b6b4659 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:35.425694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1376/2723] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:35.855173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d82e-f675-483d-ab61-1312b45dc472 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:35.856852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00a4d82e-f675-483d-ab61-1312b45dc472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:35.868709 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc151-717e-42f1-b161-0fc97d8e30b2 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:35.869007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc151-717e-42f1-b161-0fc97d8e30b2 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:35.869292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc151-717e-42f1-b161-0fc97d8e30b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:35.881765 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d82e-f675-483d-ab61-1312b45dc472 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:35.887231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:35.888303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:35.888497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:35.888938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] PATH_INFO: `/v3/projects/0e86e4c7808b4fd7be2b892d43bdbce4` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:35.890479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e86e4c7808b4fd7be2b892d43bdbce4)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:35.893122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:35.900810 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-18ccc151-717e-42f1-b161-0fc97d8e30b2 None None] MFA Rules not processed for user `9e68f1722227477cbbacd4813cd4f4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:35.902083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-18ccc151-717e-42f1-b161-0fc97d8e30b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:35.948790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e86e4c7808b4fd7be2b892d43bdbce4', 'request_id': 'req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.957232 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e86e4c7808b4fd7be2b892d43bdbce4', 'request_id': 'req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.963820 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e86e4c7808b4fd7be2b892d43bdbce4', 'request_id': 'req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.976578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] The token cache is being invalidate because project 0e86e4c7808b4fd7be2b892d43bdbce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:35.976859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.977562 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:35.979454 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1348/2724] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:35 2022] DELETE /identity/v3/projects/0e86e4c7808b4fd7be2b892d43bdbce4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:35.984367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1377/2725] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:35.987245 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:35.989728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:35.995111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc151-717e-42f1-b161-0fc97d8e30b2 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:35.997074 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-18ccc151-717e-42f1-b161-0fc97d8e30b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:36.066515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd04c1-80a0-4e0b-b3dc-e859d60f514f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:36.073627 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc151-717e-42f1-b161-0fc97d8e30b2 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:36.078557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:36.079476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:36.079728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:36.080004 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] PATH_INFO: `/v3/users/96c82fa303374a24ba5243b74a219404` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:36.081226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c82fa303374a24ba5243b74a219404)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:36.083636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:36.132267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f5ee8-e6fd-4a05-a008-ed288c521b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:36.132994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5ee8-e6fd-4a05-a008-ed288c521b46 service cinder] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:36.133214 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5ee8-e6fd-4a05-a008-ed288c521b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:36.133462 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5ee8-e6fd-4a05-a008-ed288c521b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:36.135398 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e06f5ee8-e6fd-4a05-a008-ed288c521b46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:36.146908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c82fa303374a24ba5243b74a219404'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.169493 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c82fa303374a24ba5243b74a219404'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.177356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c82fa303374a24ba5243b74a219404'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.178564 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c82fa303374a24ba5243b74a219404'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.187912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c82fa303374a24ba5243b74a219404'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.194955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1349/2726] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:35 2022] DELETE /identity/v3/users/96c82fa303374a24ba5243b74a219404 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:36.209146 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5ee8-e6fd-4a05-a008-ed288c521b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:36.210634 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5ee8-e6fd-4a05-a008-ed288c521b46 service cinder] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:36.222630 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1378/2727] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:06:36.486728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:36.491496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:36.561727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ea9f-9bf8-45d8-92c0-0ba63ed3a94e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:36.566365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:36.567774 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:36.568055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:36.568327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] PATH_INFO: `/v3/projects/223b20427c1f45e98cc446de9f269db9` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:36.569693 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223b20427c1f45e98cc446de9f269db9)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:36.571665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:36.619145 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223b20427c1f45e98cc446de9f269db9', 'request_id': 'req-142f3a14-b80d-4f38-8c28-2aa781df82d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.625816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223b20427c1f45e98cc446de9f269db9', 'request_id': 'req-142f3a14-b80d-4f38-8c28-2aa781df82d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.631679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223b20427c1f45e98cc446de9f269db9', 'request_id': 'req-142f3a14-b80d-4f38-8c28-2aa781df82d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.642441 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] The token cache is being invalidate because project 223b20427c1f45e98cc446de9f269db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:36.642722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.643332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-142f3a14-b80d-4f38-8c28-2aa781df82d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:36.644928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1350/2728] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:36 2022] DELETE /identity/v3/projects/223b20427c1f45e98cc446de9f269db9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:36.649913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e77a38-778d-4466-9354-d588f3c4e637 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:36.650396 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e77a38-778d-4466-9354-d588f3c4e637 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:36.650519 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e77a38-778d-4466-9354-d588f3c4e637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:36.668480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-63e77a38-778d-4466-9354-d588f3c4e637 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:36.669818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-63e77a38-778d-4466-9354-d588f3c4e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:36.728269 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1379/2729] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:36.736602 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408da6f-f492-4389-96d0-65c1f075c170 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:36.736835 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408da6f-f492-4389-96d0-65c1f075c170 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:36.737117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408da6f-f492-4389-96d0-65c1f075c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:36.755358 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6408da6f-f492-4389-96d0-65c1f075c170 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:36.756586 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6408da6f-f492-4389-96d0-65c1f075c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:36.764509 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1351/2730] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:36.768832 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e77a38-778d-4466-9354-d588f3c4e637 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:36.779005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e77a38-778d-4466-9354-d588f3c4e637 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:36.783473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c82a5-4e44-4e4e-b27e-898a2130df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:36.784112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c82a5-4e44-4e4e-b27e-898a2130df15 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:36.784390 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c82a5-4e44-4e4e-b27e-898a2130df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:36.784662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c82a5-4e44-4e4e-b27e-898a2130df15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:36.785936 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c82a5-4e44-4e4e-b27e-898a2130df15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:36.786262 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c82a5-4e44-4e4e-b27e-898a2130df15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:36.787931 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c82a5-4e44-4e4e-b27e-898a2130df15 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:36.799658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1380/2731] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:06:36.804157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408da6f-f492-4389-96d0-65c1f075c170 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:36.813263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408da6f-f492-4389-96d0-65c1f075c170 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:36.817921 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d9fa-c2ba-49f5-a40f-ae14c418d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:36.818566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d9fa-c2ba-49f5-a40f-ae14c418d8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:36.818857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d9fa-c2ba-49f5-a40f-ae14c418d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:36.819136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d9fa-c2ba-49f5-a40f-ae14c418d8f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:36.819832 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685d9fa-c2ba-49f5-a40f-ae14c418d8f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:36.821749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685d9fa-c2ba-49f5-a40f-ae14c418d8f4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:36.845833 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1352/2732] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:36 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:36.850412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c82a5-4e44-4e4e-b27e-898a2130df15 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:36.862953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c82a5-4e44-4e4e-b27e-898a2130df15 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:36.920073 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417151ab-7ec0-456d-b286-7f81d0ffd7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:36.920875 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417151ab-7ec0-456d-b286-7f81d0ffd7ab admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:36.921171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417151ab-7ec0-456d-b286-7f81d0ffd7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:36.921505 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417151ab-7ec0-456d-b286-7f81d0ffd7ab admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:36.922349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417151ab-7ec0-456d-b286-7f81d0ffd7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:36.924478 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417151ab-7ec0-456d-b286-7f81d0ffd7ab admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:36.948494 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1381/2733] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:36 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:36.952578 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d9fa-c2ba-49f5-a40f-ae14c418d8f4 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:36.963456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d9fa-c2ba-49f5-a40f-ae14c418d8f4 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:36.968455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d03490-fe60-42de-b7b2-a50b28db9add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:36.969129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03490-fe60-42de-b7b2-a50b28db9add admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:36.969414 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03490-fe60-42de-b7b2-a50b28db9add admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:36.969792 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03490-fe60-42de-b7b2-a50b28db9add admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:36.970519 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d03490-fe60-42de-b7b2-a50b28db9add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:36.972113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d03490-fe60-42de-b7b2-a50b28db9add admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:36.983193 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1353/2734] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:36.986900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417151ab-7ec0-456d-b286-7f81d0ffd7ab admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:36.997173 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417151ab-7ec0-456d-b286-7f81d0ffd7ab admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:37.001994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed7bc4-6a31-4605-b2bd-37e0baf8dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:37.002650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed7bc4-6a31-4605-b2bd-37e0baf8dab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:37.002952 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed7bc4-6a31-4605-b2bd-37e0baf8dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:37.003225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed7bc4-6a31-4605-b2bd-37e0baf8dab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:37.003953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed7bc4-6a31-4605-b2bd-37e0baf8dab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:37.006095 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed7bc4-6a31-4605-b2bd-37e0baf8dab6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:37.015902 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1382/2735] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:06:37.020573 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d03490-fe60-42de-b7b2-a50b28db9add admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:37.030453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d03490-fe60-42de-b7b2-a50b28db9add admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:37.035088 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896dba7-2045-4fc1-9d6e-75397c9f02ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:37.035955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896dba7-2045-4fc1-9d6e-75397c9f02ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:37.036236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896dba7-2045-4fc1-9d6e-75397c9f02ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:37.036510 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896dba7-2045-4fc1-9d6e-75397c9f02ee admin admin] PATH_INFO: `/v3/projects/ac196e75b746478c8ca28495d0971916/users/345b44fe3ae849fb8f0a529d33e64679/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:37.050491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896dba7-2045-4fc1-9d6e-75397c9f02ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac196e75b746478c8ca28495d0971916, user_id=345b44fe3ae849fb8f0a529d33e64679, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:37.053141 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896dba7-2045-4fc1-9d6e-75397c9f02ee admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:37.065433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1354/2736] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:37 2022] PUT /identity/v3/projects/ac196e75b746478c8ca28495d0971916/users/345b44fe3ae849fb8f0a529d33e64679/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:37.070948 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862baf-3c6a-4151-a87a-ce03b1d440d1 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:37.071250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862baf-3c6a-4151-a87a-ce03b1d440d1 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:37.071529 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862baf-3c6a-4151-a87a-ce03b1d440d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:37.089430 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-0e862baf-3c6a-4151-a87a-ce03b1d440d1 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:37.090725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0e862baf-3c6a-4151-a87a-ce03b1d440d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:37.159440 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1383/2737] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:37.171956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896dba7-2045-4fc1-9d6e-75397c9f02ee admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:37.175070 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7896dba7-2045-4fc1-9d6e-75397c9f02ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:37.231721 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896dba7-2045-4fc1-9d6e-75397c9f02ee admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:37.235380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46be88a-ef57-4ba8-bd7c-f2d6a707cc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:37.236019 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46be88a-ef57-4ba8-bd7c-f2d6a707cc8d service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:37.236307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46be88a-ef57-4ba8-bd7c-f2d6a707cc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:37.236587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46be88a-ef57-4ba8-bd7c-f2d6a707cc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:37.246001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46be88a-ef57-4ba8-bd7c-f2d6a707cc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:37.247371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46be88a-ef57-4ba8-bd7c-f2d6a707cc8d service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:37.257147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1355/2738] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:37.617883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe2b91-7ccc-476d-b141-d4f6e7c60a4d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:37.618253 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe2b91-7ccc-476d-b141-d4f6e7c60a4d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:37.618592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe2b91-7ccc-476d-b141-d4f6e7c60a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:37.640632 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-82fe2b91-7ccc-476d-b141-d4f6e7c60a4d None None] MFA Rules not processed for user `9e68f1722227477cbbacd4813cd4f4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:37.641947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-82fe2b91-7ccc-476d-b141-d4f6e7c60a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:37.718618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1384/2739] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:42.080881 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2126d-2c4d-4cc6-a16f-e10a08c4e588 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:42.081465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2126d-2c4d-4cc6-a16f-e10a08c4e588 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:42.081465 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2126d-2c4d-4cc6-a16f-e10a08c4e588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:42.120196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-42a2126d-2c4d-4cc6-a16f-e10a08c4e588 None None] MFA Rules not processed for user `345b44fe3ae849fb8f0a529d33e64679`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:42.121596 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-42a2126d-2c4d-4cc6-a16f-e10a08c4e588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:42.199302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1356/2740] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:42.203964 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe2b91-7ccc-476d-b141-d4f6e7c60a4d None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:42.217699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe2b91-7ccc-476d-b141-d4f6e7c60a4d None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:42.225313 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c7d1e-f1fd-41f9-ac31-645d0be616e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:42.226371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c7d1e-f1fd-41f9-ac31-645d0be616e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:42.226900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c7d1e-f1fd-41f9-ac31-645d0be616e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:42.227406 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c7d1e-f1fd-41f9-ac31-645d0be616e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:42.228133 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c7d1e-f1fd-41f9-ac31-645d0be616e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:42.230438 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c7d1e-f1fd-41f9-ac31-645d0be616e2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:42.260415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1385/2741] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:42 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:42.264558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2126d-2c4d-4cc6-a16f-e10a08c4e588 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:42.292423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2126d-2c4d-4cc6-a16f-e10a08c4e588 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:42.370953 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc466a-6b2d-4290-b145-adbde2e0dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:42.371730 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc466a-6b2d-4290-b145-adbde2e0dd10 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:42.372082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc466a-6b2d-4290-b145-adbde2e0dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:42.372424 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc466a-6b2d-4290-b145-adbde2e0dd10 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:42.373194 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc466a-6b2d-4290-b145-adbde2e0dd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:42.375255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc466a-6b2d-4290-b145-adbde2e0dd10 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:42.396494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1357/2742] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:42 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:42.400402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c7d1e-f1fd-41f9-ac31-645d0be616e2 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:42.417691 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c7d1e-f1fd-41f9-ac31-645d0be616e2 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:42.422734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bc1e0-19c2-4654-82f7-edadaa0f4f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:42.423416 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bc1e0-19c2-4654-82f7-edadaa0f4f9c admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:42.423699 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bc1e0-19c2-4654-82f7-edadaa0f4f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:42.423974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bc1e0-19c2-4654-82f7-edadaa0f4f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:42.424704 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bc1e0-19c2-4654-82f7-edadaa0f4f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:42.426461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bc1e0-19c2-4654-82f7-edadaa0f4f9c admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:42.437776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1386/2743] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:42.441980 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc466a-6b2d-4290-b145-adbde2e0dd10 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:42.452240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc466a-6b2d-4290-b145-adbde2e0dd10 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:42.457485 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0a1b-da75-4e67-ae34-7afd5b75fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:42.458419 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0a1b-da75-4e67-ae34-7afd5b75fc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:42.458701 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0a1b-da75-4e67-ae34-7afd5b75fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:42.458972 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0a1b-da75-4e67-ae34-7afd5b75fc62 admin admin] PATH_INFO: `/v3/projects/10202842bca14ed8b384ceca7724b8b6/users/26a33fd920a941df96f487abade2b8f6/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:42.478476 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e0a1b-da75-4e67-ae34-7afd5b75fc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10202842bca14ed8b384ceca7724b8b6, user_id=26a33fd920a941df96f487abade2b8f6, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:42.481168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e0a1b-da75-4e67-ae34-7afd5b75fc62 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:42.500364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1358/2744] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:42 2022] PUT /identity/v3/projects/10202842bca14ed8b384ceca7724b8b6/users/26a33fd920a941df96f487abade2b8f6/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:42.504171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bc1e0-19c2-4654-82f7-edadaa0f4f9c admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:42.514068 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bc1e0-19c2-4654-82f7-edadaa0f4f9c admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:42.605899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea1332-4674-4e9f-8d8e-aea62279fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:42.606570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea1332-4674-4e9f-8d8e-aea62279fa25 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:42.606848 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea1332-4674-4e9f-8d8e-aea62279fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:42.607180 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea1332-4674-4e9f-8d8e-aea62279fa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:42.607859 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea1332-4674-4e9f-8d8e-aea62279fa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:42.609453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea1332-4674-4e9f-8d8e-aea62279fa25 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:42.625558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1387/2745] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:42.626815 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0a1b-da75-4e67-ae34-7afd5b75fc62 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:42.637331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0a1b-da75-4e67-ae34-7afd5b75fc62 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:42.642184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1284d8-2465-40aa-8ad2-106030822c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:42.643082 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1284d8-2465-40aa-8ad2-106030822c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:42.643359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1284d8-2465-40aa-8ad2-106030822c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:42.643630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1284d8-2465-40aa-8ad2-106030822c68 admin admin] PATH_INFO: `/v3/projects/10202842bca14ed8b384ceca7724b8b6/users/26a33fd920a941df96f487abade2b8f6/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:42.646332 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1284d8-2465-40aa-8ad2-106030822c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10202842bca14ed8b384ceca7724b8b6, user_id=26a33fd920a941df96f487abade2b8f6, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:42.649033 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1284d8-2465-40aa-8ad2-106030822c68 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:42.665916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1359/2746] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:42 2022] PUT /identity/v3/projects/10202842bca14ed8b384ceca7724b8b6/users/26a33fd920a941df96f487abade2b8f6/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:44.035012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea1332-4674-4e9f-8d8e-aea62279fa25 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:44.037295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-1fea1332-4674-4e9f-8d8e-aea62279fa25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:44.060795 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea1332-4674-4e9f-8d8e-aea62279fa25 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:44.130666 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:44.131831 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:44.132277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:44.132748 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] PATH_INFO: `/v3/users/fb2be205ae4a433f855d9d53423696c5` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:44.134010 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2be205ae4a433f855d9d53423696c5)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:44.136310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:44.216898 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2be205ae4a433f855d9d53423696c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:44.217679 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2be205ae4a433f855d9d53423696c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:44.233205 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2be205ae4a433f855d9d53423696c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:44.242803 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2be205ae4a433f855d9d53423696c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:44.254746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2be205ae4a433f855d9d53423696c5'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:44.273265 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1388/2747] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:44 2022] DELETE /identity/v3/users/fb2be205ae4a433f855d9d53423696c5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:44.279255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea53fa-5080-446c-b908-4283904daf27 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:44.279751 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea53fa-5080-446c-b908-4283904daf27 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:44.280757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea53fa-5080-446c-b908-4283904daf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:44.308719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3aea53fa-5080-446c-b908-4283904daf27 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:44.310394 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3aea53fa-5080-446c-b908-4283904daf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:44.389477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1360/2748] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:44.399340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:44.400797 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:44.498220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd887ab-cbb8-45a6-bcd9-7403e66f1b66 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:44.502368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665c071-cc37-442b-93a9-397b5ea79064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:44.503027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c071-cc37-442b-93a9-397b5ea79064 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:44.503314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c071-cc37-442b-93a9-397b5ea79064 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:44.504125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c071-cc37-442b-93a9-397b5ea79064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:44.515884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665c071-cc37-442b-93a9-397b5ea79064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:44.517496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665c071-cc37-442b-93a9-397b5ea79064 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:44.538659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1389/2749] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:06:45.067173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea53fa-5080-446c-b908-4283904daf27 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:45.068804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3aea53fa-5080-446c-b908-4283904daf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:45.095511 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea53fa-5080-446c-b908-4283904daf27 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:45.110122 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:45.112030 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:45.112323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:45.112604 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] PATH_INFO: `/v3/projects/2110f15cb17e45b78dbac9d2ff603582` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:45.116209 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2110f15cb17e45b78dbac9d2ff603582)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:45.118222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:45.230405 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2110f15cb17e45b78dbac9d2ff603582', 'request_id': 'req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:45.248595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2110f15cb17e45b78dbac9d2ff603582', 'request_id': 'req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:45.259131 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2110f15cb17e45b78dbac9d2ff603582', 'request_id': 'req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:45.289126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] The token cache is being invalidate because project 2110f15cb17e45b78dbac9d2ff603582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:45.290288 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:45.291337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6586e356-ea8a-41b1-a7f6-dc49b0a845ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:45.293221 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1361/2750] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:45 2022] DELETE /identity/v3/projects/2110f15cb17e45b78dbac9d2ff603582 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:45.298234 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2618-0a64-42b3-92cd-c20504601d0f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:45.298716 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2618-0a64-42b3-92cd-c20504601d0f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:45.298802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2618-0a64-42b3-92cd-c20504601d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:45.332083 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-5f9b2618-0a64-42b3-92cd-c20504601d0f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:45.342320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-5f9b2618-0a64-42b3-92cd-c20504601d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:45.438963 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1390/2751] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:45.446955 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9bb6-95e9-4817-a616-a97e56f24fb5 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:45.447502 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9bb6-95e9-4817-a616-a97e56f24fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:45.447963 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9bb6-95e9-4817-a616-a97e56f24fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:45.482713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-56eb9bb6-95e9-4817-a616-a97e56f24fb5 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:45.483964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-56eb9bb6-95e9-4817-a616-a97e56f24fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:45.501506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1362/2752] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:45.505864 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2618-0a64-42b3-92cd-c20504601d0f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:45.517322 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2618-0a64-42b3-92cd-c20504601d0f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:45.527261 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598133ef-3d1b-4819-9aa2-956d3b6eee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:45.527961 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598133ef-3d1b-4819-9aa2-956d3b6eee8b admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:45.528695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598133ef-3d1b-4819-9aa2-956d3b6eee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:45.529142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598133ef-3d1b-4819-9aa2-956d3b6eee8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:45.530079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598133ef-3d1b-4819-9aa2-956d3b6eee8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:45.530775 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598133ef-3d1b-4819-9aa2-956d3b6eee8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:45.533350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598133ef-3d1b-4819-9aa2-956d3b6eee8b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:45.570044 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1391/2753] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:06:45.574012 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9bb6-95e9-4817-a616-a97e56f24fb5 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:45.587364 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9bb6-95e9-4817-a616-a97e56f24fb5 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:45.599191 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c95e7-dd5e-419f-baaf-dcbcd4fbcc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:45.599876 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c95e7-dd5e-419f-baaf-dcbcd4fbcc5a admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:45.600158 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c95e7-dd5e-419f-baaf-dcbcd4fbcc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:45.600443 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c95e7-dd5e-419f-baaf-dcbcd4fbcc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:45.601136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c95e7-dd5e-419f-baaf-dcbcd4fbcc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:45.603081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c95e7-dd5e-419f-baaf-dcbcd4fbcc5a admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:45.648470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1363/2754] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:45 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:45.654301 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598133ef-3d1b-4819-9aa2-956d3b6eee8b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:45.669577 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598133ef-3d1b-4819-9aa2-956d3b6eee8b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:45.773207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab958ee8-f45f-417e-9bd6-024594a7463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:45.773927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab958ee8-f45f-417e-9bd6-024594a7463d admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:45.774215 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab958ee8-f45f-417e-9bd6-024594a7463d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:45.774499 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab958ee8-f45f-417e-9bd6-024594a7463d admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:45.775201 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab958ee8-f45f-417e-9bd6-024594a7463d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:45.777232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab958ee8-f45f-417e-9bd6-024594a7463d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:45.814851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1392/2755] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:45 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:06:45.819029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c95e7-dd5e-419f-baaf-dcbcd4fbcc5a admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:45.833976 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c95e7-dd5e-419f-baaf-dcbcd4fbcc5a admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:45.846914 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff219f-01c7-4d49-8c18-e549135eff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:45.850150 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff219f-01c7-4d49-8c18-e549135eff72 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:45.850444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff219f-01c7-4d49-8c18-e549135eff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:45.850726 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff219f-01c7-4d49-8c18-e549135eff72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:45.851482 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff219f-01c7-4d49-8c18-e549135eff72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:45.857462 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff219f-01c7-4d49-8c18-e549135eff72 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:45.883231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1364/2756] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:45.887883 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab958ee8-f45f-417e-9bd6-024594a7463d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:45.900112 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab958ee8-f45f-417e-9bd6-024594a7463d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:45.905464 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a911b2-9a7d-44eb-95e2-e99f05e6678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:45.906187 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a911b2-9a7d-44eb-95e2-e99f05e6678a admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:45.906469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a911b2-9a7d-44eb-95e2-e99f05e6678a admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:45.906763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a911b2-9a7d-44eb-95e2-e99f05e6678a admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:45.913974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a911b2-9a7d-44eb-95e2-e99f05e6678a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:45.916534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a911b2-9a7d-44eb-95e2-e99f05e6678a admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:45.932974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1393/2757] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:45.933495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff219f-01c7-4d49-8c18-e549135eff72 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:45.958760 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff219f-01c7-4d49-8c18-e549135eff72 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:45.965381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361b0a-a008-4faa-9e98-8c87dc4051a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:45.966419 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361b0a-a008-4faa-9e98-8c87dc4051a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:45.966794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361b0a-a008-4faa-9e98-8c87dc4051a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:45.967180 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361b0a-a008-4faa-9e98-8c87dc4051a3 admin admin] PATH_INFO: `/v3/projects/378993eeced04e2289fee8819e5fe0f1/users/18a7b0f3ea754aff9d2718fe1b6a5fc2/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:45.999946 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361b0a-a008-4faa-9e98-8c87dc4051a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378993eeced04e2289fee8819e5fe0f1, user_id=18a7b0f3ea754aff9d2718fe1b6a5fc2, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:46.004343 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361b0a-a008-4faa-9e98-8c87dc4051a3 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:46.034225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1365/2758] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:45 2022] PUT /identity/v3/projects/378993eeced04e2289fee8819e5fe0f1/users/18a7b0f3ea754aff9d2718fe1b6a5fc2/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:06:46.046959 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe53e8c-7771-4235-afe2-025c0e333c40 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:46.047306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe53e8c-7771-4235-afe2-025c0e333c40 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:46.047521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe53e8c-7771-4235-afe2-025c0e333c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:46.080781 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-6fe53e8c-7771-4235-afe2-025c0e333c40 None None] MFA Rules not processed for user `18a7b0f3ea754aff9d2718fe1b6a5fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:46.082175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-6fe53e8c-7771-4235-afe2-025c0e333c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:46.249867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1394/2759] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:46.255849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361b0a-a008-4faa-9e98-8c87dc4051a3 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:46.258535 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e0361b0a-a008-4faa-9e98-8c87dc4051a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:46.353298 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361b0a-a008-4faa-9e98-8c87dc4051a3 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:46.358727 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed099a3-d477-414e-b407-4d9c2304c3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:46.359313 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed099a3-d477-414e-b407-4d9c2304c3dd service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:46.359610 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed099a3-d477-414e-b407-4d9c2304c3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:46.359892 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed099a3-d477-414e-b407-4d9c2304c3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:46.392137 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed099a3-d477-414e-b407-4d9c2304c3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:46.395243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed099a3-d477-414e-b407-4d9c2304c3dd service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:46.410515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1366/2760] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:48.648005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe1f56-07a1-4106-89fa-28cd8cc8fa6b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:48.648582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe1f56-07a1-4106-89fa-28cd8cc8fa6b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:48.648582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe1f56-07a1-4106-89fa-28cd8cc8fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:48.693268 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-83fe1f56-07a1-4106-89fa-28cd8cc8fa6b None None] MFA Rules not processed for user `26a33fd920a941df96f487abade2b8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:48.694587 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-83fe1f56-07a1-4106-89fa-28cd8cc8fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:48.778166 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1395/2761] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:48.789802 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed099a3-d477-414e-b407-4d9c2304c3dd service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:48.791226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-aed099a3-d477-414e-b407-4d9c2304c3dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:48.846333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed099a3-d477-414e-b407-4d9c2304c3dd service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:48.849969 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066d62c015e9483e87e4bd64ce8c4df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:48.850608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:48.850888 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:48.851168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:48.852937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:48.915691 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:48.917314 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:48.927766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1367/2762] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:49.064001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566626d-570a-4142-bbfe-4af2e6ffb9c9 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:49.064290 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566626d-570a-4142-bbfe-4af2e6ffb9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:49.064567 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566626d-570a-4142-bbfe-4af2e6ffb9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:49.084633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f566626d-570a-4142-bbfe-4af2e6ffb9c9 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:49.086037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f566626d-570a-4142-bbfe-4af2e6ffb9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:49.149158 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1396/2763] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:49.161849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:49.163371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:49.263127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c42d16-f1ec-4167-b0d0-601f2b6cf1bd service glance] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:49.275479 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702d07a-e27d-43cd-a60a-fe67d77f6b65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:49.276172 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702d07a-e27d-43cd-a60a-fe67d77f6b65 service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:49.276455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702d07a-e27d-43cd-a60a-fe67d77f6b65 service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:49.276728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702d07a-e27d-43cd-a60a-fe67d77f6b65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:49.286830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702d07a-e27d-43cd-a60a-fe67d77f6b65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:49.289801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702d07a-e27d-43cd-a60a-fe67d77f6b65 service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:49.301634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1368/2764] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:06:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:06:49.802031 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566626d-570a-4142-bbfe-4af2e6ffb9c9 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:49.901429 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566626d-570a-4142-bbfe-4af2e6ffb9c9 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:49.907025 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:49.907911 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:49.908197 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:49.908470 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] PATH_INFO: `/v3/users/18a7b0f3ea754aff9d2718fe1b6a5fc2` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:49.909752 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a7b0f3ea754aff9d2718fe1b6a5fc2)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:49.911693 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:49.966923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a7b0f3ea754aff9d2718fe1b6a5fc2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:49.967923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a7b0f3ea754aff9d2718fe1b6a5fc2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:49.981295 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a7b0f3ea754aff9d2718fe1b6a5fc2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:49.982139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a7b0f3ea754aff9d2718fe1b6a5fc2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:49.996488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a7b0f3ea754aff9d2718fe1b6a5fc2'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:50.015352 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1397/2765] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:06:49 2022] DELETE /identity/v3/users/18a7b0f3ea754aff9d2718fe1b6a5fc2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:50.016791 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e947ad-d7dd-4967-8412-85b0d45e4da7 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:50.017316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e947ad-d7dd-4967-8412-85b0d45e4da7 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:50.017316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e947ad-d7dd-4967-8412-85b0d45e4da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:50.051809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-09e947ad-d7dd-4967-8412-85b0d45e4da7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:50.053354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-09e947ad-d7dd-4967-8412-85b0d45e4da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:50.180115 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1369/2766] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:06:50.191570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:50.193163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:50.271648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fb1ff-823f-4dc5-80d6-e8d8aea5bebd admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:50.276880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ebe8f-6c3d-48d7-8f0f-74529d341815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:50.277939 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ebe8f-6c3d-48d7-8f0f-74529d341815 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:50.278292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ebe8f-6c3d-48d7-8f0f-74529d341815 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:50.278661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ebe8f-6c3d-48d7-8f0f-74529d341815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:50.299113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ebe8f-6c3d-48d7-8f0f-74529d341815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:50.302305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ebe8f-6c3d-48d7-8f0f-74529d341815 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:50.324945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1398/2767] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:50.797346 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e947ad-d7dd-4967-8412-85b0d45e4da7 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:50.799269 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-09e947ad-d7dd-4967-8412-85b0d45e4da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:50.817138 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e947ad-d7dd-4967-8412-85b0d45e4da7 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:50.823475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:50.824570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:50.824859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:50.825266 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] PATH_INFO: `/v3/projects/378993eeced04e2289fee8819e5fe0f1` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:50.827944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378993eeced04e2289fee8819e5fe0f1)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:50.830305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:50.895382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378993eeced04e2289fee8819e5fe0f1', 'request_id': 'req-fa651a45-b5b5-42fe-94f2-fe31daa32362'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:50.909457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378993eeced04e2289fee8819e5fe0f1', 'request_id': 'req-fa651a45-b5b5-42fe-94f2-fe31daa32362'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:50.918676 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378993eeced04e2289fee8819e5fe0f1', 'request_id': 'req-fa651a45-b5b5-42fe-94f2-fe31daa32362'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:50.933074 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] The token cache is being invalidate because project 378993eeced04e2289fee8819e5fe0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:06:50.933369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:50.934103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-fa651a45-b5b5-42fe-94f2-fe31daa32362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:06:50.937095 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1370/2768] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:06:50 2022] DELETE /identity/v3/projects/378993eeced04e2289fee8819e5fe0f1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:50.942613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624a6b-23be-4bf5-b359-f23dcf1d341f None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:50.943192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624a6b-23be-4bf5-b359-f23dcf1d341f None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:50.943192 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624a6b-23be-4bf5-b359-f23dcf1d341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:50.981833 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-ea624a6b-23be-4bf5-b359-f23dcf1d341f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:50.983401 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ea624a6b-23be-4bf5-b359-f23dcf1d341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:51.095836 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eff096-a33a-44e8-9c96-679d3a19af25 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:51.097429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eff096-a33a-44e8-9c96-679d3a19af25 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:51.097889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1399/2769] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:51.098592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eff096-a33a-44e8-9c96-679d3a19af25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:51.124766 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a1eff096-a33a-44e8-9c96-679d3a19af25 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:51.126307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a1eff096-a33a-44e8-9c96-679d3a19af25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:51.145331 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1371/2770] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:51.146372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea624a6b-23be-4bf5-b359-f23dcf1d341f None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:51.158585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea624a6b-23be-4bf5-b359-f23dcf1d341f None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:51.165136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4cdb7-2001-4c22-ab80-0fd070777e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:51.166371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4cdb7-2001-4c22-ab80-0fd070777e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:51.166840 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4cdb7-2001-4c22-ab80-0fd070777e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:51.167749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4cdb7-2001-4c22-ab80-0fd070777e5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:51.168662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4cdb7-2001-4c22-ab80-0fd070777e5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:06:51.169154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4cdb7-2001-4c22-ab80-0fd070777e5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:51.170988 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4cdb7-2001-4c22-ab80-0fd070777e5f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:51.188728 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1400/2771] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:06:51.193154 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eff096-a33a-44e8-9c96-679d3a19af25 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:51.203737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eff096-a33a-44e8-9c96-679d3a19af25 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:51.210096 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a38a7-515c-4327-abe6-b111212fad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:51.210851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a38a7-515c-4327-abe6-b111212fad95 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:51.211206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a38a7-515c-4327-abe6-b111212fad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:51.211558 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a38a7-515c-4327-abe6-b111212fad95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:51.212399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a38a7-515c-4327-abe6-b111212fad95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:51.214788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a38a7-515c-4327-abe6-b111212fad95 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:51.245938 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1372/2772] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:06:51 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:51.249849 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4cdb7-2001-4c22-ab80-0fd070777e5f admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:51.262126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4cdb7-2001-4c22-ab80-0fd070777e5f admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:51.354140 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d000ec-19b5-4257-b584-957f3072549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:51.355510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d000ec-19b5-4257-b584-957f3072549d admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:51.356107 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d000ec-19b5-4257-b584-957f3072549d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:51.356626 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d000ec-19b5-4257-b584-957f3072549d admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:51.357827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d000ec-19b5-4257-b584-957f3072549d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:51.360306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d000ec-19b5-4257-b584-957f3072549d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:51.395356 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a38a7-515c-4327-abe6-b111212fad95 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:51.395594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1401/2773] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:06:51 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:06:51.425791 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a38a7-515c-4327-abe6-b111212fad95 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:51.438751 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275355e-e42d-4825-992a-03519db10dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:51.440560 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275355e-e42d-4825-992a-03519db10dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:51.442048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275355e-e42d-4825-992a-03519db10dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:51.443559 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275355e-e42d-4825-992a-03519db10dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:51.445908 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275355e-e42d-4825-992a-03519db10dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:51.448287 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275355e-e42d-4825-992a-03519db10dc7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:51.473301 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1373/2774] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:51.475368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d000ec-19b5-4257-b584-957f3072549d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:51.490096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d000ec-19b5-4257-b584-957f3072549d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:51.504569 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e08a20-ab3a-466f-afd9-dd7976ecc16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:51.505332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e08a20-ab3a-466f-afd9-dd7976ecc16f admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:51.505635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e08a20-ab3a-466f-afd9-dd7976ecc16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:51.505923 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e08a20-ab3a-466f-afd9-dd7976ecc16f admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:51.508585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e08a20-ab3a-466f-afd9-dd7976ecc16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:51.513620 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e08a20-ab3a-466f-afd9-dd7976ecc16f admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:51.554494 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275355e-e42d-4825-992a-03519db10dc7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:51.571518 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1402/2775] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:06:51.576379 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275355e-e42d-4825-992a-03519db10dc7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:51.593944 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7a51-78b6-4b13-8179-ca775192fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:51.595272 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7a51-78b6-4b13-8179-ca775192fef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:51.596329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7a51-78b6-4b13-8179-ca775192fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:51.596804 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7a51-78b6-4b13-8179-ca775192fef5 admin admin] PATH_INFO: `/v3/projects/3b302a864c9f4813b6102a928c224747/users/23e7d6e9cdd742918dadce3338d0363c/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:51.634075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd7a51-78b6-4b13-8179-ca775192fef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b302a864c9f4813b6102a928c224747, user_id=23e7d6e9cdd742918dadce3338d0363c, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:51.637109 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd7a51-78b6-4b13-8179-ca775192fef5 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:51.704127 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1374/2776] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:06:51 2022] PUT /identity/v3/projects/3b302a864c9f4813b6102a928c224747/users/23e7d6e9cdd742918dadce3338d0363c/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:06:51.716193 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5e1fd-e84e-4b2a-bd42-0b4f9af9c545 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:51.716723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5e1fd-e84e-4b2a-bd42-0b4f9af9c545 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:51.717229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5e1fd-e84e-4b2a-bd42-0b4f9af9c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:51.760695 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-d9b5e1fd-e84e-4b2a-bd42-0b4f9af9c545 None None] MFA Rules not processed for user `23e7d6e9cdd742918dadce3338d0363c`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:51.762113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d9b5e1fd-e84e-4b2a-bd42-0b4f9af9c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:51.880482 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1403/2777] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:06:59.187772 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7a51-78b6-4b13-8179-ca775192fef5 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:06:59.189554 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-58cd7a51-78b6-4b13-8179-ca775192fef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:59.260563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7a51-78b6-4b13-8179-ca775192fef5 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:06:59.261677 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11a85-ebf7-4cbc-a88e-9ffe3c5707cf None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:59.262222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11a85-ebf7-4cbc-a88e-9ffe3c5707cf None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:59.262222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11a85-ebf7-4cbc-a88e-9ffe3c5707cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:59.264207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfc569-ff4d-4982-a36c-62737bd5492b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066d62c015e9483e87e4bd64ce8c4df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:06:59.264853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfc569-ff4d-4982-a36c-62737bd5492b service glance] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:06:59.265136 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfc569-ff4d-4982-a36c-62737bd5492b service glance] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:06:59.265411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfc569-ff4d-4982-a36c-62737bd5492b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:06:59.273843 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfc569-ff4d-4982-a36c-62737bd5492b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:06:59.275282 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfc569-ff4d-4982-a36c-62737bd5492b service glance] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:06:59.280650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f6f11a85-ebf7-4cbc-a88e-9ffe3c5707cf None None] MFA Rules not processed for user `345b44fe3ae849fb8f0a529d33e64679`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:06:59.282239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f6f11a85-ebf7-4cbc-a88e-9ffe3c5707cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:06:59.286344 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1375/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:06:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:06:59.342292 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1404/2779] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:06:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:07:05.384189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161dea3-68a0-426b-b767-c55b4e5d66a0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:05.384746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161dea3-68a0-426b-b767-c55b4e5d66a0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:05.384746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161dea3-68a0-426b-b767-c55b4e5d66a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:05.410365 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-6161dea3-68a0-426b-b767-c55b4e5d66a0 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:05.411974 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6161dea3-68a0-426b-b767-c55b4e5d66a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:05.478048 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1376/2780] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 12 19:07:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:05.490867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f11a85-ebf7-4cbc-a88e-9ffe3c5707cf None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:05.492339 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f6f11a85-ebf7-4cbc-a88e-9ffe3c5707cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:05.560357 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f11a85-ebf7-4cbc-a88e-9ffe3c5707cf None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:05.565409 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4b50b-d07b-443a-a76c-37224e39e13b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:05.566101 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4b50b-d07b-443a-a76c-37224e39e13b service swift] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:05.566388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4b50b-d07b-443a-a76c-37224e39e13b service swift] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:05.566663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4b50b-d07b-443a-a76c-37224e39e13b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:05.575237 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4b50b-d07b-443a-a76c-37224e39e13b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:05.576876 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4b50b-d07b-443a-a76c-37224e39e13b service swift] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:05.586860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1405/2781] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:07:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:07:07.646380 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161dea3-68a0-426b-b767-c55b4e5d66a0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:07.648633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6161dea3-68a0-426b-b767-c55b4e5d66a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:07.725218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161dea3-68a0-426b-b767-c55b4e5d66a0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:07.730377 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:07.731258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:07.731543 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:07.731816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] PATH_INFO: `/v3/users/cbe3491f272248e7a3a8e464c51e23d2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:07.733062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe3491f272248e7a3a8e464c51e23d2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:07.735213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:07.787406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe3491f272248e7a3a8e464c51e23d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:07.799970 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe3491f272248e7a3a8e464c51e23d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:07.806859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe3491f272248e7a3a8e464c51e23d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:07.807633 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe3491f272248e7a3a8e464c51e23d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:07.816571 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe3491f272248e7a3a8e464c51e23d2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:07.823637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1377/2782] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:07:07 2022] DELETE /identity/v3/users/cbe3491f272248e7a3a8e464c51e23d2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:07:07.828085 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998921bc-0f81-4068-95be-333fe0cd882d None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:07.828584 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998921bc-0f81-4068-95be-333fe0cd882d None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:07.828672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998921bc-0f81-4068-95be-333fe0cd882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:07.847514 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-998921bc-0f81-4068-95be-333fe0cd882d None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:07.848762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-998921bc-0f81-4068-95be-333fe0cd882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:07.912195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1406/2783] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:07.922423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:07.924565 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:07.985898 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f556f3-1e2b-405d-aa15-504756653d3b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:07.990081 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f6a0d-2a97-4252-afa4-e3ee78706cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:07.990736 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f6a0d-2a97-4252-afa4-e3ee78706cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:07.991043 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f6a0d-2a97-4252-afa4-e3ee78706cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:07.991445 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f6a0d-2a97-4252-afa4-e3ee78706cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:08.018020 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f6a0d-2a97-4252-afa4-e3ee78706cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:08.019675 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f6a0d-2a97-4252-afa4-e3ee78706cf5 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:08.035234 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1378/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:07:08.531644 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998921bc-0f81-4068-95be-333fe0cd882d None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:08.533692 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-998921bc-0f81-4068-95be-333fe0cd882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:08.546477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998921bc-0f81-4068-95be-333fe0cd882d None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:08.552618 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:08.553817 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:08.554291 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:08.554747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] PATH_INFO: `/v3/projects/805ef00e215c4b33b65da357a18eb4bb` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:08.556242 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805ef00e215c4b33b65da357a18eb4bb)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:08.558741 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:08.616387 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805ef00e215c4b33b65da357a18eb4bb', 'request_id': 'req-c9658c82-310e-4b7c-bd59-d148f222c763'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:08.624340 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805ef00e215c4b33b65da357a18eb4bb', 'request_id': 'req-c9658c82-310e-4b7c-bd59-d148f222c763'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:08.631466 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805ef00e215c4b33b65da357a18eb4bb', 'request_id': 'req-c9658c82-310e-4b7c-bd59-d148f222c763'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:08.651057 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] The token cache is being invalidate because project 805ef00e215c4b33b65da357a18eb4bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:07:08.651745 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:08.652561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-c9658c82-310e-4b7c-bd59-d148f222c763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:08.654684 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1407/2785] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:07:08 2022] DELETE /identity/v3/projects/805ef00e215c4b33b65da357a18eb4bb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:07:08.659966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617faad-6550-4862-9766-561f6fe25d96 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:08.660997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617faad-6550-4862-9766-561f6fe25d96 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:08.661355 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617faad-6550-4862-9766-561f6fe25d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:08.682814 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-7617faad-6550-4862-9766-561f6fe25d96 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:08.684126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-7617faad-6550-4862-9766-561f6fe25d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:08.765738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1379/2786] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:07:08.773581 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe6b5-d130-4c80-82ea-16b87c190ba7 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:08.773882 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe6b5-d130-4c80-82ea-16b87c190ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:08.774163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe6b5-d130-4c80-82ea-16b87c190ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:08.794065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-01afe6b5-d130-4c80-82ea-16b87c190ba7 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:08.795315 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-01afe6b5-d130-4c80-82ea-16b87c190ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:08.806589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1408/2787] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:08.808223 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617faad-6550-4862-9766-561f6fe25d96 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:08.825429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617faad-6550-4862-9766-561f6fe25d96 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:08.831735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf597a5-52e6-4724-9adf-f0269a360e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:08.832440 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf597a5-52e6-4724-9adf-f0269a360e15 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:08.832719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf597a5-52e6-4724-9adf-f0269a360e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:08.832992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf597a5-52e6-4724-9adf-f0269a360e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:08.833750 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf597a5-52e6-4724-9adf-f0269a360e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:07:08.834058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf597a5-52e6-4724-9adf-f0269a360e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:08.835681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf597a5-52e6-4724-9adf-f0269a360e15 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:08.849023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1380/2788] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:07:08.853332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe6b5-d130-4c80-82ea-16b87c190ba7 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:08.863932 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe6b5-d130-4c80-82ea-16b87c190ba7 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:08.869480 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c9280-4827-4dc7-b393-3ffb26ef2465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:08.870538 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c9280-4827-4dc7-b393-3ffb26ef2465 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:08.870985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c9280-4827-4dc7-b393-3ffb26ef2465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:08.872428 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c9280-4827-4dc7-b393-3ffb26ef2465 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:08.873206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c9280-4827-4dc7-b393-3ffb26ef2465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:08.875163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c9280-4827-4dc7-b393-3ffb26ef2465 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:08.902001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1409/2789] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:07:08 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:07:08.906500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf597a5-52e6-4724-9adf-f0269a360e15 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:08.921196 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf597a5-52e6-4724-9adf-f0269a360e15 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:08.997319 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7aeec-7ebf-42ef-9e5b-bbf3166c7fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:08.998632 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7aeec-7ebf-42ef-9e5b-bbf3166c7fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:08.998992 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7aeec-7ebf-42ef-9e5b-bbf3166c7fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:08.999338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7aeec-7ebf-42ef-9e5b-bbf3166c7fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:09.000112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7aeec-7ebf-42ef-9e5b-bbf3166c7fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:09.003163 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7aeec-7ebf-42ef-9e5b-bbf3166c7fb1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:09.027718 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1381/2790] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:07:08 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:07:09.030544 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c9280-4827-4dc7-b393-3ffb26ef2465 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:09.041659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c9280-4827-4dc7-b393-3ffb26ef2465 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:09.046371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c1a3-be35-4eef-942c-ab72d6e3b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:09.047039 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c1a3-be35-4eef-942c-ab72d6e3b0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:09.047320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c1a3-be35-4eef-942c-ab72d6e3b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:09.047593 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c1a3-be35-4eef-942c-ab72d6e3b0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:09.048321 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15c1a3-be35-4eef-942c-ab72d6e3b0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:09.050510 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15c1a3-be35-4eef-942c-ab72d6e3b0a0 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:09.064543 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1410/2791] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:07:09.071126 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7aeec-7ebf-42ef-9e5b-bbf3166c7fb1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:09.081423 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7aeec-7ebf-42ef-9e5b-bbf3166c7fb1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:09.087058 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3be285-70f5-48c1-a2ed-2d5f80a4edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:09.087743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3be285-70f5-48c1-a2ed-2d5f80a4edbc admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:09.088034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3be285-70f5-48c1-a2ed-2d5f80a4edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:09.088357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3be285-70f5-48c1-a2ed-2d5f80a4edbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:09.089152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3be285-70f5-48c1-a2ed-2d5f80a4edbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:09.090840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3be285-70f5-48c1-a2ed-2d5f80a4edbc admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:09.102156 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1382/2792] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:07:09.107485 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c1a3-be35-4eef-942c-ab72d6e3b0a0 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:09.121933 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c1a3-be35-4eef-942c-ab72d6e3b0a0 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:09.127195 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb46c30-1257-4799-ba60-781e17af5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:09.128079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb46c30-1257-4799-ba60-781e17af5186 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:09.128369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb46c30-1257-4799-ba60-781e17af5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:09.128633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb46c30-1257-4799-ba60-781e17af5186 admin admin] PATH_INFO: `/v3/projects/ab7dbf84e4d74021b021fbf20b99a7c9/users/dfae4bc82b774dc1bb8c98990b6a4ac7/roles/4a765555b657413ea79721175a7191e3` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:09.144477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb46c30-1257-4799-ba60-781e17af5186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7dbf84e4d74021b021fbf20b99a7c9, user_id=dfae4bc82b774dc1bb8c98990b6a4ac7, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:09.147791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb46c30-1257-4799-ba60-781e17af5186 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:09.169582 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1411/2793] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:07:09 2022] PUT /identity/v3/projects/ab7dbf84e4d74021b021fbf20b99a7c9/users/dfae4bc82b774dc1bb8c98990b6a4ac7/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:07:09.171670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde817b-d0f5-4919-a082-0ccecc270fbc None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:09.171966 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde817b-d0f5-4919-a082-0ccecc270fbc None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:09.172330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde817b-d0f5-4919-a082-0ccecc270fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:09.195444 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-4dde817b-d0f5-4919-a082-0ccecc270fbc None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:09.196809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-4dde817b-d0f5-4919-a082-0ccecc270fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:09.320649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1383/2794] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:09.331461 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb46c30-1257-4799-ba60-781e17af5186 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:09.333484 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ebb46c30-1257-4799-ba60-781e17af5186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:09.399844 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb46c30-1257-4799-ba60-781e17af5186 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:09.404013 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af10a-d3b7-40c5-b7f8-f44f9eab8f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:09.404667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af10a-d3b7-40c5-b7f8-f44f9eab8f7e service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:09.404947 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af10a-d3b7-40c5-b7f8-f44f9eab8f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:09.405222 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af10a-d3b7-40c5-b7f8-f44f9eab8f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:09.416507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2af10a-d3b7-40c5-b7f8-f44f9eab8f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:09.418000 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2af10a-d3b7-40c5-b7f8-f44f9eab8f7e service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:09.429610 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1412/2795] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:07:14.787354 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94906b-21d2-4c1e-945a-ce1de6eacd33 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:14.788515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94906b-21d2-4c1e-945a-ce1de6eacd33 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:14.789029 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94906b-21d2-4c1e-945a-ce1de6eacd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:14.822208 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-fd94906b-21d2-4c1e-945a-ce1de6eacd33 None None] MFA Rules not processed for user `dfae4bc82b774dc1bb8c98990b6a4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:14.823338 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fd94906b-21d2-4c1e-945a-ce1de6eacd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:14.910636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1384/2796] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:14.914903 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af10a-d3b7-40c5-b7f8-f44f9eab8f7e service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:14.925028 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af10a-d3b7-40c5-b7f8-f44f9eab8f7e service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:14.929706 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba5df3-f1f6-4c86-8867-c2546f3ffc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:14.930613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba5df3-f1f6-4c86-8867-c2546f3ffc50 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:14.930899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba5df3-f1f6-4c86-8867-c2546f3ffc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:14.931171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba5df3-f1f6-4c86-8867-c2546f3ffc50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:14.931858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba5df3-f1f6-4c86-8867-c2546f3ffc50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:14.933774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba5df3-f1f6-4c86-8867-c2546f3ffc50 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:14.960278 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1413/2797] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:07:14 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:07:14.964912 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94906b-21d2-4c1e-945a-ce1de6eacd33 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:14.976432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94906b-21d2-4c1e-945a-ce1de6eacd33 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:15.032371 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296f113-8656-4dc3-9fe0-ff9257ffdbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:15.033601 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f113-8656-4dc3-9fe0-ff9257ffdbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:15.033887 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f113-8656-4dc3-9fe0-ff9257ffdbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:15.034161 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f113-8656-4dc3-9fe0-ff9257ffdbc6 admin admin] PATH_INFO: `/v3/users` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:15.034859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296f113-8656-4dc3-9fe0-ff9257ffdbc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:15.036770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296f113-8656-4dc3-9fe0-ff9257ffdbc6 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:15.060258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1385/2798] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:07:14 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:07:15.066955 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba5df3-f1f6-4c86-8867-c2546f3ffc50 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:15.100308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba5df3-f1f6-4c86-8867-c2546f3ffc50 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:15.105075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7fef4-111b-4491-a587-5390d2aab94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:15.105784 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7fef4-111b-4491-a587-5390d2aab94d admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:15.106066 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7fef4-111b-4491-a587-5390d2aab94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:15.106373 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7fef4-111b-4491-a587-5390d2aab94d admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:15.107558 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7fef4-111b-4491-a587-5390d2aab94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:15.109160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7fef4-111b-4491-a587-5390d2aab94d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:15.121927 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1414/2799] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:07:15.126023 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296f113-8656-4dc3-9fe0-ff9257ffdbc6 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:15.145997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296f113-8656-4dc3-9fe0-ff9257ffdbc6 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:15.150776 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4627ec-befa-4358-b887-c2b302ebc3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:15.151937 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4627ec-befa-4358-b887-c2b302ebc3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:15.152222 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4627ec-befa-4358-b887-c2b302ebc3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:15.152501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4627ec-befa-4358-b887-c2b302ebc3ec admin admin] PATH_INFO: `/v3/projects/8f0cc8e0097e4b8ea23d639b32dc9d71/users/744d92a902f54353a8214e9d362a77ec/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:15.178243 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4627ec-befa-4358-b887-c2b302ebc3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0cc8e0097e4b8ea23d639b32dc9d71, user_id=744d92a902f54353a8214e9d362a77ec, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:15.181117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4627ec-befa-4358-b887-c2b302ebc3ec admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:15.201518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1386/2800] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:07:15 2022] PUT /identity/v3/projects/8f0cc8e0097e4b8ea23d639b32dc9d71/users/744d92a902f54353a8214e9d362a77ec/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:07:15.205974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7fef4-111b-4491-a587-5390d2aab94d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:15.222246 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7fef4-111b-4491-a587-5390d2aab94d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:15.295595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276c755-b07b-4a50-99df-704713db823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:15.296552 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276c755-b07b-4a50-99df-704713db823b admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:15.297007 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276c755-b07b-4a50-99df-704713db823b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:15.297283 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276c755-b07b-4a50-99df-704713db823b admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:15.298052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276c755-b07b-4a50-99df-704713db823b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:15.299860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276c755-b07b-4a50-99df-704713db823b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:15.310332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1415/2801] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:07:15.315022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4627ec-befa-4358-b887-c2b302ebc3ec admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:15.327524 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4627ec-befa-4358-b887-c2b302ebc3ec admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:15.333877 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b6ec9-e82c-45c2-a5d0-a9e8122fa9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:15.334713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b6ec9-e82c-45c2-a5d0-a9e8122fa9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:15.334997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b6ec9-e82c-45c2-a5d0-a9e8122fa9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:15.335275 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b6ec9-e82c-45c2-a5d0-a9e8122fa9e1 admin admin] PATH_INFO: `/v3/projects/8f0cc8e0097e4b8ea23d639b32dc9d71/users/744d92a902f54353a8214e9d362a77ec/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:15.337360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b6ec9-e82c-45c2-a5d0-a9e8122fa9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0cc8e0097e4b8ea23d639b32dc9d71, user_id=744d92a902f54353a8214e9d362a77ec, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:15.340026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b6ec9-e82c-45c2-a5d0-a9e8122fa9e1 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:15.351254 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1387/2802] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:07:15 2022] PUT /identity/v3/projects/8f0cc8e0097e4b8ea23d639b32dc9d71/users/744d92a902f54353a8214e9d362a77ec/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:07:20.446388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1e551-b74c-41a7-bdbe-cb7034371570 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:20.447052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1e551-b74c-41a7-bdbe-cb7034371570 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:20.447052 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1e551-b74c-41a7-bdbe-cb7034371570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:20.476360 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-67c1e551-b74c-41a7-bdbe-cb7034371570 None None] MFA Rules not processed for user `744d92a902f54353a8214e9d362a77ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:20.477599 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-67c1e551-b74c-41a7-bdbe-cb7034371570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:20.546096 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1416/2803] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:07:20.560515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b6ec9-e82c-45c2-a5d0-a9e8122fa9e1 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:20.562206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-388b6ec9-e82c-45c2-a5d0-a9e8122fa9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:20.641125 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b6ec9-e82c-45c2-a5d0-a9e8122fa9e1 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:20.647051 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3c538-e71f-4a19-a1a6-d12afc48f7ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:20.647698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3c538-e71f-4a19-a1a6-d12afc48f7ee service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:20.647984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3c538-e71f-4a19-a1a6-d12afc48f7ee service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:20.648251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3c538-e71f-4a19-a1a6-d12afc48f7ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:20.706373 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3c538-e71f-4a19-a1a6-d12afc48f7ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:20.707960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3c538-e71f-4a19-a1a6-d12afc48f7ee service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:20.716654 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1388/2804] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:07:34.969871 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1e551-b74c-41a7-bdbe-cb7034371570 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:34.971368 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-67c1e551-b74c-41a7-bdbe-cb7034371570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:35.035323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1e551-b74c-41a7-bdbe-cb7034371570 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:35.040010 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:35.040870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.041150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.041422 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] PATH_INFO: `/v3/users/23e7d6e9cdd742918dadce3338d0363c` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.042641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e7d6e9cdd742918dadce3338d0363c)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:35.044553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:35.096592 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e7d6e9cdd742918dadce3338d0363c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.097243 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e7d6e9cdd742918dadce3338d0363c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.108968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e7d6e9cdd742918dadce3338d0363c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.109718 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e7d6e9cdd742918dadce3338d0363c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.116723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e7d6e9cdd742918dadce3338d0363c'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.128763 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1417/2805] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:07:34 2022] DELETE /identity/v3/users/23e7d6e9cdd742918dadce3338d0363c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:07:35.133100 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c73d0a-c3a2-4adc-a7a5-c315c9f5f873 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.133577 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c73d0a-c3a2-4adc-a7a5-c315c9f5f873 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.133746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c73d0a-c3a2-4adc-a7a5-c315c9f5f873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.153315 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-b3c73d0a-c3a2-4adc-a7a5-c315c9f5f873 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:35.154720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b3c73d0a-c3a2-4adc-a7a5-c315c9f5f873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:35.212705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1389/2806] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:35.222830 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:35.224312 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:35.284585 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85b36-533a-4e58-8ede-a58f589187bb admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:35.288224 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b8778-178b-44fd-af0b-e05ed708ae6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:35.288872 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b8778-178b-44fd-af0b-e05ed708ae6a service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.289153 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b8778-178b-44fd-af0b-e05ed708ae6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.289426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b8778-178b-44fd-af0b-e05ed708ae6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.299417 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b8778-178b-44fd-af0b-e05ed708ae6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:35.300465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b8778-178b-44fd-af0b-e05ed708ae6a service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:35.310022 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1418/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:07:35.576665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c73d0a-c3a2-4adc-a7a5-c315c9f5f873 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:35.578616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b3c73d0a-c3a2-4adc-a7a5-c315c9f5f873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:35.590368 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c73d0a-c3a2-4adc-a7a5-c315c9f5f873 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:35.595563 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:35.596418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.596700 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.596964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] PATH_INFO: `/v3/projects/3b302a864c9f4813b6102a928c224747` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.598296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b302a864c9f4813b6102a928c224747)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:35.600183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:35.647982 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b302a864c9f4813b6102a928c224747', 'request_id': 'req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.655819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b302a864c9f4813b6102a928c224747', 'request_id': 'req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.661280 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b302a864c9f4813b6102a928c224747', 'request_id': 'req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.672495 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] The token cache is being invalidate because project 3b302a864c9f4813b6102a928c224747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:07:35.672777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.673399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-d60e0b6f-0f80-4aab-b46e-5cd9b87cc9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:35.674960 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1390/2808] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:07:35 2022] DELETE /identity/v3/projects/3b302a864c9f4813b6102a928c224747 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:07:35.679807 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6f384-9628-40c3-bc4d-1328b14bb68b None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.680092 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6f384-9628-40c3-bc4d-1328b14bb68b None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.680362 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6f384-9628-40c3-bc4d-1328b14bb68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.705867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-74e6f384-9628-40c3-bc4d-1328b14bb68b None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:35.707041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-74e6f384-9628-40c3-bc4d-1328b14bb68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:35.764524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1419/2809] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:35.772680 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79505562-7b4c-4fe3-9371-c1e6825d000f None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.772973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79505562-7b4c-4fe3-9371-c1e6825d000f None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.773263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79505562-7b4c-4fe3-9371-c1e6825d000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.791810 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-79505562-7b4c-4fe3-9371-c1e6825d000f None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:35.793013 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-79505562-7b4c-4fe3-9371-c1e6825d000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:35.800854 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1391/2810] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:35.804888 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6f384-9628-40c3-bc4d-1328b14bb68b None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:35.814380 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6f384-9628-40c3-bc4d-1328b14bb68b None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:35.818854 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca26571-a81c-4d35-b083-1a5660e71005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:35.819488 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26571-a81c-4d35-b083-1a5660e71005 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.819767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26571-a81c-4d35-b083-1a5660e71005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.820037 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26571-a81c-4d35-b083-1a5660e71005 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.820746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca26571-a81c-4d35-b083-1a5660e71005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:07:35.821049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca26571-a81c-4d35-b083-1a5660e71005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:35.822661 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca26571-a81c-4d35-b083-1a5660e71005 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:35.834232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1420/2811] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 19:07:35.838093 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79505562-7b4c-4fe3-9371-c1e6825d000f None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:35.847858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79505562-7b4c-4fe3-9371-c1e6825d000f None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:35.852448 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040906e-4294-41ee-a8bf-0bd31115a23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:35.853103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040906e-4294-41ee-a8bf-0bd31115a23b admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.853388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040906e-4294-41ee-a8bf-0bd31115a23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.853703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040906e-4294-41ee-a8bf-0bd31115a23b admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.854399 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040906e-4294-41ee-a8bf-0bd31115a23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:35.856296 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040906e-4294-41ee-a8bf-0bd31115a23b admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:35.880385 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1392/2812] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:07:35 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:07:35.884474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca26571-a81c-4d35-b083-1a5660e71005 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:35.894571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca26571-a81c-4d35-b083-1a5660e71005 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:35.948747 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7c150-8f05-4626-8dd0-0bb0728481f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:35.949441 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7c150-8f05-4626-8dd0-0bb0728481f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.949736 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7c150-8f05-4626-8dd0-0bb0728481f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.950036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7c150-8f05-4626-8dd0-0bb0728481f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.950727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7c150-8f05-4626-8dd0-0bb0728481f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:35.952663 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7c150-8f05-4626-8dd0-0bb0728481f3 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:35.975334 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1421/2813] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:07:35 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:07:35.976491 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040906e-4294-41ee-a8bf-0bd31115a23b admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:35.986636 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040906e-4294-41ee-a8bf-0bd31115a23b admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:35.991210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375a207-91bf-4496-bec5-f16daba01a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:35.991857 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375a207-91bf-4496-bec5-f16daba01a83 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:35.992139 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375a207-91bf-4496-bec5-f16daba01a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:35.992412 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375a207-91bf-4496-bec5-f16daba01a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:35.993134 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375a207-91bf-4496-bec5-f16daba01a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:35.994757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375a207-91bf-4496-bec5-f16daba01a83 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:36.005258 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1393/2814] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:07:36.009170 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7c150-8f05-4626-8dd0-0bb0728481f3 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:36.019682 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7c150-8f05-4626-8dd0-0bb0728481f3 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:36.024277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2901c96-7536-4339-bcda-f687df94e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:36.024984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2901c96-7536-4339-bcda-f687df94e731 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:36.025267 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2901c96-7536-4339-bcda-f687df94e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:36.025827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2901c96-7536-4339-bcda-f687df94e731 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:36.026546 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2901c96-7536-4339-bcda-f687df94e731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:36.028131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2901c96-7536-4339-bcda-f687df94e731 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:36.038760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1422/2815] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:07:36.042917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375a207-91bf-4496-bec5-f16daba01a83 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:36.052729 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375a207-91bf-4496-bec5-f16daba01a83 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:36.057214 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a10d9d-adc8-40c6-b471-ffb712a4416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:36.058110 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a10d9d-adc8-40c6-b471-ffb712a4416f admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:36.058390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a10d9d-adc8-40c6-b471-ffb712a4416f admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:36.058667 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a10d9d-adc8-40c6-b471-ffb712a4416f admin admin] PATH_INFO: `/v3/projects/5adecde6583e4528a530f91d3e5642ba/users/2720d979c3714c08a1cd22dd271fb0aa/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:36.073797 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a10d9d-adc8-40c6-b471-ffb712a4416f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adecde6583e4528a530f91d3e5642ba, user_id=2720d979c3714c08a1cd22dd271fb0aa, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:36.076411 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a10d9d-adc8-40c6-b471-ffb712a4416f admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:36.096757 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1394/2816] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:07:36 2022] PUT /identity/v3/projects/5adecde6583e4528a530f91d3e5642ba/users/2720d979c3714c08a1cd22dd271fb0aa/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:07:36.107088 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37c8b-2fae-468c-b87e-5f5ca26520e3 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:36.107373 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37c8b-2fae-468c-b87e-5f5ca26520e3 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:36.107648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37c8b-2fae-468c-b87e-5f5ca26520e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:36.133303 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-fce37c8b-2fae-468c-b87e-5f5ca26520e3 None None] MFA Rules not processed for user `2720d979c3714c08a1cd22dd271fb0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:36.134662 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fce37c8b-2fae-468c-b87e-5f5ca26520e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:36.198667 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1423/2817] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:36.209616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a10d9d-adc8-40c6-b471-ffb712a4416f admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:36.211323 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-26a10d9d-adc8-40c6-b471-ffb712a4416f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:36.266675 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a10d9d-adc8-40c6-b471-ffb712a4416f admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:36.270307 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbeac7-e086-4bc4-8d7c-bac2a673ce3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:36.270941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbeac7-e086-4bc4-8d7c-bac2a673ce3b service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:36.271225 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbeac7-e086-4bc4-8d7c-bac2a673ce3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:36.271501 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbeac7-e086-4bc4-8d7c-bac2a673ce3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:36.279751 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbeac7-e086-4bc4-8d7c-bac2a673ce3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:36.281260 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbeac7-e086-4bc4-8d7c-bac2a673ce3b service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:36.289801 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1395/2818] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:07:38.360225 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce37c8b-2fae-468c-b87e-5f5ca26520e3 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:38.362130 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fce37c8b-2fae-468c-b87e-5f5ca26520e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:38.425135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce37c8b-2fae-468c-b87e-5f5ca26520e3 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:38.428779 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e8885-d1ca-494c-962f-28ae33c8fdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:38.429415 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8885-d1ca-494c-962f-28ae33c8fdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:38.429723 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8885-d1ca-494c-962f-28ae33c8fdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:38.429997 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8885-d1ca-494c-962f-28ae33c8fdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:38.431785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d74e8885-d1ca-494c-962f-28ae33c8fdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:38.493264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e8885-d1ca-494c-962f-28ae33c8fdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:38.494651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e8885-d1ca-494c-962f-28ae33c8fdb1 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:38.504486 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1424/2819] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:07:40.132917 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbeac7-e086-4bc4-8d7c-bac2a673ce3b service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:40.134463 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-dedbeac7-e086-4bc4-8d7c-bac2a673ce3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:40.231062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbeac7-e086-4bc4-8d7c-bac2a673ce3b service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:40.238418 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:40.239265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:40.239733 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:40.240129 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:40.242143 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:40.255598 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:40.257360 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:40.269660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1396/2820] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:07:44.723659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fe5b4-e3d4-411b-8a07-14432bc82639 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:44.724125 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fe5b4-e3d4-411b-8a07-14432bc82639 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:44.724238 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fe5b4-e3d4-411b-8a07-14432bc82639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:44.742469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-e92fe5b4-e3d4-411b-8a07-14432bc82639 None None] MFA Rules not processed for user `dfae4bc82b774dc1bb8c98990b6a4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:44.743891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-e92fe5b4-e3d4-411b-8a07-14432bc82639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:44.806310 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1425/2821] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:46.096548 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:46.098017 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:46.188291 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925643-8f4b-4fda-b13f-a5bb220621fb service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:46.194419 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f38ac-efc0-470d-b934-3c2d79bd10c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf772e34d8f14923bb9c1fe883fd3926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:46.195117 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f38ac-efc0-470d-b934-3c2d79bd10c9 service placement] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:46.195403 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f38ac-efc0-470d-b934-3c2d79bd10c9 service placement] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:46.195671 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f38ac-efc0-470d-b934-3c2d79bd10c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:46.197867 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-977f38ac-efc0-470d-b934-3c2d79bd10c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:46.209646 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f38ac-efc0-470d-b934-3c2d79bd10c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:46.211215 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f38ac-efc0-470d-b934-3c2d79bd10c9 service placement] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:46.221236 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1397/2822] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:07:50.212791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fe5b4-e3d4-411b-8a07-14432bc82639 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:50.276660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fe5b4-e3d4-411b-8a07-14432bc82639 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:50.281651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:50.282524 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:50.282774 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:50.283046 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] PATH_INFO: `/v3/users/2720d979c3714c08a1cd22dd271fb0aa` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:50.284217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2720d979c3714c08a1cd22dd271fb0aa)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:50.286175 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:50.330294 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2720d979c3714c08a1cd22dd271fb0aa'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:50.330938 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2720d979c3714c08a1cd22dd271fb0aa'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:50.343472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2720d979c3714c08a1cd22dd271fb0aa'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:50.344159 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2720d979c3714c08a1cd22dd271fb0aa'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:50.351496 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2720d979c3714c08a1cd22dd271fb0aa'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:50.363969 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1426/2823] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:07:50 2022] DELETE /identity/v3/users/2720d979c3714c08a1cd22dd271fb0aa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:07:50.368580 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b66b-4548-41cf-8251-4cc91408e08e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:50.369068 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b66b-4548-41cf-8251-4cc91408e08e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:50.369188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b66b-4548-41cf-8251-4cc91408e08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:50.386660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-1eb5b66b-4548-41cf-8251-4cc91408e08e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:50.387950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1eb5b66b-4548-41cf-8251-4cc91408e08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:50.451105 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1398/2824] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:50.462916 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:50.464150 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:50.532863 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7d69f-f250-4829-b9bf-04117ecf3129 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:50.537314 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37feb082-1657-498b-9ce4-3796c9b24565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:50.538123 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feb082-1657-498b-9ce4-3796c9b24565 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:50.538477 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feb082-1657-498b-9ce4-3796c9b24565 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:50.538760 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feb082-1657-498b-9ce4-3796c9b24565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:50.549264 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37feb082-1657-498b-9ce4-3796c9b24565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:50.550767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37feb082-1657-498b-9ce4-3796c9b24565 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:50.565608 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1427/2825] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:07:50.878742 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b66b-4548-41cf-8251-4cc91408e08e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:50.882230 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1eb5b66b-4548-41cf-8251-4cc91408e08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:50.896830 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b66b-4548-41cf-8251-4cc91408e08e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:50.906433 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:50.907770 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:50.908152 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:50.908460 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] PATH_INFO: `/v3/projects/5adecde6583e4528a530f91d3e5642ba` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:50.910637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adecde6583e4528a530f91d3e5642ba)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:50.912648 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:50.973672 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adecde6583e4528a530f91d3e5642ba', 'request_id': 'req-6c013775-9fb1-4638-aa0e-074a380b0ad4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:50.982210 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adecde6583e4528a530f91d3e5642ba', 'request_id': 'req-6c013775-9fb1-4638-aa0e-074a380b0ad4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:50.989649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adecde6583e4528a530f91d3e5642ba', 'request_id': 'req-6c013775-9fb1-4638-aa0e-074a380b0ad4'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:51.004472 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] The token cache is being invalidate because project 5adecde6583e4528a530f91d3e5642ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:07:51.004812 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:51.005503 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-6c013775-9fb1-4638-aa0e-074a380b0ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:07:51.010959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1399/2826] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:07:50 2022] DELETE /identity/v3/projects/5adecde6583e4528a530f91d3e5642ba => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:07:51.012588 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66897b17-1c4d-4ff2-a34a-f0584306edf5 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.013016 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66897b17-1c4d-4ff2-a34a-f0584306edf5 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.013472 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66897b17-1c4d-4ff2-a34a-f0584306edf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.044182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-66897b17-1c4d-4ff2-a34a-f0584306edf5 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:51.045465 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-66897b17-1c4d-4ff2-a34a-f0584306edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:51.145354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1428/2827] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 19:07:51.147249 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f8616-b986-42cd-8271-a05dfe25154e None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.147557 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f8616-b986-42cd-8271-a05dfe25154e None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.147819 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f8616-b986-42cd-8271-a05dfe25154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.168078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-0e0f8616-b986-42cd-8271-a05dfe25154e None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:51.169401 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-0e0f8616-b986-42cd-8271-a05dfe25154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:51.179706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1400/2828] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:51.184221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66897b17-1c4d-4ff2-a34a-f0584306edf5 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:51.194332 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66897b17-1c4d-4ff2-a34a-f0584306edf5 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:51.199104 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a9e93-78ad-4293-bbcf-dc6300f6e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:51.199762 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a9e93-78ad-4293-bbcf-dc6300f6e222 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.200043 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a9e93-78ad-4293-bbcf-dc6300f6e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.200349 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a9e93-78ad-4293-bbcf-dc6300f6e222 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.201063 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a9e93-78ad-4293-bbcf-dc6300f6e222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:07:51.201369 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a9e93-78ad-4293-bbcf-dc6300f6e222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:51.203672 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a9e93-78ad-4293-bbcf-dc6300f6e222 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:51.217597 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1429/2829] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:07:51.220330 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f8616-b986-42cd-8271-a05dfe25154e None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:51.230456 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f8616-b986-42cd-8271-a05dfe25154e None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:51.235480 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd2fe-704d-4a48-958c-8f9f9012ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:51.236375 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd2fe-704d-4a48-958c-8f9f9012ea34 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.236660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd2fe-704d-4a48-958c-8f9f9012ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.236940 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd2fe-704d-4a48-958c-8f9f9012ea34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.237677 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd2fe-704d-4a48-958c-8f9f9012ea34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:51.239595 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd2fe-704d-4a48-958c-8f9f9012ea34 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:51.268400 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1401/2830] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:07:51 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:07:51.272724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a9e93-78ad-4293-bbcf-dc6300f6e222 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:51.283394 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a9e93-78ad-4293-bbcf-dc6300f6e222 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:51.340277 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3607df8-c9c1-4c24-beb7-b0cc41a0f8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:51.340631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607df8-c9c1-4c24-beb7-b0cc41a0f8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.340894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607df8-c9c1-4c24-beb7-b0cc41a0f8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.341171 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607df8-c9c1-4c24-beb7-b0cc41a0f8f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.341904 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3607df8-c9c1-4c24-beb7-b0cc41a0f8f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:51.343894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3607df8-c9c1-4c24-beb7-b0cc41a0f8f2 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:51.366986 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1430/2831] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:07:51 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:07:51.371091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd2fe-704d-4a48-958c-8f9f9012ea34 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:51.382370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd2fe-704d-4a48-958c-8f9f9012ea34 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:51.387026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa37c0-0294-4215-8fb1-acba7d291745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:51.387679 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa37c0-0294-4215-8fb1-acba7d291745 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.387959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa37c0-0294-4215-8fb1-acba7d291745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.388231 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa37c0-0294-4215-8fb1-acba7d291745 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.388950 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa37c0-0294-4215-8fb1-acba7d291745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:51.390652 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa37c0-0294-4215-8fb1-acba7d291745 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:51.401670 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1402/2832] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:07:51.405622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3607df8-c9c1-4c24-beb7-b0cc41a0f8f2 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:51.415296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3607df8-c9c1-4c24-beb7-b0cc41a0f8f2 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:51.419866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcc1c4-a008-469b-a842-d0fbc7e0bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:51.420517 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc1c4-a008-469b-a842-d0fbc7e0bde7 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.420862 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc1c4-a008-469b-a842-d0fbc7e0bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.421680 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc1c4-a008-469b-a842-d0fbc7e0bde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.422402 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcc1c4-a008-469b-a842-d0fbc7e0bde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:51.424026 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcc1c4-a008-469b-a842-d0fbc7e0bde7 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:51.433613 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1431/2833] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:07:51.437432 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa37c0-0294-4215-8fb1-acba7d291745 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:51.447396 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa37c0-0294-4215-8fb1-acba7d291745 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:51.451848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31211c0e-b885-48f5-8536-0132626deea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:51.452732 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31211c0e-b885-48f5-8536-0132626deea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.453011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31211c0e-b885-48f5-8536-0132626deea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.453286 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31211c0e-b885-48f5-8536-0132626deea9 admin admin] PATH_INFO: `/v3/projects/5aa8bc53e79e4cab92e26cab61a86148/users/39315ceabbbe472aaa513eb08c5313c2/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.466931 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31211c0e-b885-48f5-8536-0132626deea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa8bc53e79e4cab92e26cab61a86148, user_id=39315ceabbbe472aaa513eb08c5313c2, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:51.470470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31211c0e-b885-48f5-8536-0132626deea9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:51.482251 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1403/2834] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:07:51 2022] PUT /identity/v3/projects/5aa8bc53e79e4cab92e26cab61a86148/users/39315ceabbbe472aaa513eb08c5313c2/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:07:51.492820 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5114c-6099-43c8-9ddf-a6af34b3a7a1 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.493113 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5114c-6099-43c8-9ddf-a6af34b3a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.493395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5114c-6099-43c8-9ddf-a6af34b3a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.518685 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-52d5114c-6099-43c8-9ddf-a6af34b3a7a1 None None] MFA Rules not processed for user `39315ceabbbe472aaa513eb08c5313c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:07:51.519886 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-52d5114c-6099-43c8-9ddf-a6af34b3a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:51.580521 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1432/2835] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:07:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:07:51.592073 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31211c0e-b885-48f5-8536-0132626deea9 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:07:51.594270 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-31211c0e-b885-48f5-8536-0132626deea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:07:51.653681 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31211c0e-b885-48f5-8536-0132626deea9 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:07:51.657868 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebcaa9-47f2-4486-8f1c-20202581f65d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25d2d15ebf644b889ab453d1b7ed277', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:07:51.658505 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebcaa9-47f2-4486-8f1c-20202581f65d service cinder] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:07:51.658787 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebcaa9-47f2-4486-8f1c-20202581f65d service cinder] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:07:51.659062 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebcaa9-47f2-4486-8f1c-20202581f65d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:07:51.667278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebcaa9-47f2-4486-8f1c-20202581f65d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:07:51.668719 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebcaa9-47f2-4486-8f1c-20202581f65d service cinder] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:07:51.678031 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1404/2836] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:07:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:08:00.761160 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004821f-95fd-412d-b437-5e4db59eea89 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:00.761675 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004821f-95fd-412d-b437-5e4db59eea89 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:00.761776 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004821f-95fd-412d-b437-5e4db59eea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:00.780148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-c004821f-95fd-412d-b437-5e4db59eea89 None None] MFA Rules not processed for user `9e68f1722227477cbbacd4813cd4f4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:08:00.781320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-c004821f-95fd-412d-b437-5e4db59eea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:08:00.833296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1433/2837] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:08:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:08:01.978722 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebcaa9-47f2-4486-8f1c-20202581f65d service cinder] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:08:02.041173 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebcaa9-47f2-4486-8f1c-20202581f65d service cinder] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:08:02.048311 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:08:02.049899 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:02.050404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:02.050907 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] PATH_INFO: `/v3/users/39315ceabbbe472aaa513eb08c5313c2` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:02.052997 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=39315ceabbbe472aaa513eb08c5313c2)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:08:02.056746 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:08:02.102516 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39315ceabbbe472aaa513eb08c5313c2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.114327 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39315ceabbbe472aaa513eb08c5313c2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.120994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39315ceabbbe472aaa513eb08c5313c2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.121703 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39315ceabbbe472aaa513eb08c5313c2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.131316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39315ceabbbe472aaa513eb08c5313c2'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.137706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1405/2838] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:08:01 2022] DELETE /identity/v3/users/39315ceabbbe472aaa513eb08c5313c2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:08:02.142942 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5ec98-3ecd-4ac4-8565-f6e03a724bf8 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:02.143426 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5ec98-3ecd-4ac4-8565-f6e03a724bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:02.143530 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5ec98-3ecd-4ac4-8565-f6e03a724bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:02.160719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-eee5ec98-3ecd-4ac4-8565-f6e03a724bf8 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:08:02.161972 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-eee5ec98-3ecd-4ac4-8565-f6e03a724bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:08:02.226221 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1434/2839] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:08:02.236470 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:08:02.237883 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:08:02.295788 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bcd44-c55f-4f96-9a08-d27bfba614ae admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:08:02.300357 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0bff8-0d1e-404f-8448-39a377904b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:08:02.301000 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0bff8-0d1e-404f-8448-39a377904b58 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:02.301281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0bff8-0d1e-404f-8448-39a377904b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:02.301592 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0bff8-0d1e-404f-8448-39a377904b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:02.310665 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0bff8-0d1e-404f-8448-39a377904b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:08:02.312583 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0bff8-0d1e-404f-8448-39a377904b58 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:08:02.321853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1406/2840] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:08:02.585370 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5ec98-3ecd-4ac4-8565-f6e03a724bf8 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:08:02.586941 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-eee5ec98-3ecd-4ac4-8565-f6e03a724bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:08:02.619930 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5ec98-3ecd-4ac4-8565-f6e03a724bf8 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:08:02.626445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:08:02.626635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:02.626994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:02.627436 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] PATH_INFO: `/v3/projects/5aa8bc53e79e4cab92e26cab61a86148` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:02.628725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa8bc53e79e4cab92e26cab61a86148)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:08:02.630900 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:08:02.683858 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa8bc53e79e4cab92e26cab61a86148', 'request_id': 'req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.694163 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa8bc53e79e4cab92e26cab61a86148', 'request_id': 'req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.705469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa8bc53e79e4cab92e26cab61a86148', 'request_id': 'req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.716622 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] The token cache is being invalidate because project 5aa8bc53e79e4cab92e26cab61a86148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:08:02.716934 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.717610 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:02.719148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1435/2841] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:08:02 2022] DELETE /identity/v3/projects/5aa8bc53e79e4cab92e26cab61a86148 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:08:08.127124 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0bff8-0d1e-404f-8448-39a377904b58 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:08:08.135735 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0bff8-0d1e-404f-8448-39a377904b58 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:08:08.185022 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dd285-94f0-4639-83c4-24bf0dca2cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:08:08.186217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dd285-94f0-4639-83c4-24bf0dca2cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:08.186528 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dd285-94f0-4639-83c4-24bf0dca2cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:08.186807 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dd285-94f0-4639-83c4-24bf0dca2cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:08.188608 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-070dd285-94f0-4639-83c4-24bf0dca2cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:08:08.252709 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dd285-94f0-4639-83c4-24bf0dca2cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:08:08.254246 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dd285-94f0-4639-83c4-24bf0dca2cb4 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:08:08.263673 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1407/2842] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:08:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:08:59.354884 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:08:59.356330 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:08:59.418658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b5b4e-999d-4448-b9dc-b6717de75d0b admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:08:59.423131 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:08:59.423985 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:59.424272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:59.424571 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] PATH_INFO: `/v3/users/9e68f1722227477cbbacd4813cd4f4bc` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:59.425852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e68f1722227477cbbacd4813cd4f4bc)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:08:59.427791 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:08:59.471404 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e68f1722227477cbbacd4813cd4f4bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.472036 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e68f1722227477cbbacd4813cd4f4bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.483206 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e68f1722227477cbbacd4813cd4f4bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.483827 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e68f1722227477cbbacd4813cd4f4bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.490020 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3fed79e5-e447-4b68-94f8-f442a09b9deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e68f1722227477cbbacd4813cd4f4bc'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.501683 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1436/2843] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:08:59 2022] DELETE /identity/v3/users/9e68f1722227477cbbacd4813cd4f4bc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:08:59.667333 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dd285-94f0-4639-83c4-24bf0dca2cb4 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:08:59.678566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dd285-94f0-4639-83c4-24bf0dca2cb4 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:08:59.734923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:08:59.735800 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:59.736085 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:59.736353 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] PATH_INFO: `/v3/projects/3ff6e876f1ec44939bebef28b7dac12b` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:59.737637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff6e876f1ec44939bebef28b7dac12b)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:08:59.739566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:08:59.784018 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff6e876f1ec44939bebef28b7dac12b', 'request_id': 'req-3c520854-9872-47a5-8663-22a47cbc1107'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.790783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff6e876f1ec44939bebef28b7dac12b', 'request_id': 'req-3c520854-9872-47a5-8663-22a47cbc1107'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.796255 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff6e876f1ec44939bebef28b7dac12b', 'request_id': 'req-3c520854-9872-47a5-8663-22a47cbc1107'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.806682 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] The token cache is being invalidate because project 3ff6e876f1ec44939bebef28b7dac12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:08:59.806999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.807618 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-3c520854-9872-47a5-8663-22a47cbc1107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:08:59.809728 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1408/2844] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:08:59 2022] DELETE /identity/v3/projects/3ff6e876f1ec44939bebef28b7dac12b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:08:59.814777 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926ade-c3d2-4d33-ad57-1d52c41b0e76 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:59.815424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926ade-c3d2-4d33-ad57-1d52c41b0e76 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:59.815424 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926ade-c3d2-4d33-ad57-1d52c41b0e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:59.833507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-94926ade-c3d2-4d33-ad57-1d52c41b0e76 None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:08:59.834739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-94926ade-c3d2-4d33-ad57-1d52c41b0e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:08:59.891239 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1437/2845] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:08:59.899228 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d56377-eec7-46c9-83e2-97a3db07d0ee None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:59.899520 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d56377-eec7-46c9-83e2-97a3db07d0ee None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:59.899800 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d56377-eec7-46c9-83e2-97a3db07d0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:59.918999 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-38d56377-eec7-46c9-83e2-97a3db07d0ee None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:08:59.920226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-38d56377-eec7-46c9-83e2-97a3db07d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:08:59.928206 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1409/2846] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:08:59.932136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926ade-c3d2-4d33-ad57-1d52c41b0e76 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:08:59.942058 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926ade-c3d2-4d33-ad57-1d52c41b0e76 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:08:59.946729 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36715db0-bbfc-4ad2-8e57-4c5b5dbbc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:08:59.947367 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36715db0-bbfc-4ad2-8e57-4c5b5dbbc938 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:59.947650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36715db0-bbfc-4ad2-8e57-4c5b5dbbc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:59.947928 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36715db0-bbfc-4ad2-8e57-4c5b5dbbc938 admin admin] PATH_INFO: `/v3/domains` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:59.949190 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36715db0-bbfc-4ad2-8e57-4c5b5dbbc938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 19:08:59.949498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36715db0-bbfc-4ad2-8e57-4c5b5dbbc938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:08:59.951109 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36715db0-bbfc-4ad2-8e57-4c5b5dbbc938 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:08:59.962182 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1438/2847] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 12 19:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 19:08:59.967263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d56377-eec7-46c9-83e2-97a3db07d0ee None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:08:59.976165 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d56377-eec7-46c9-83e2-97a3db07d0ee None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:08:59.981240 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc7b4-49bf-4695-bb79-b9296c4216a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:08:59.981941 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc7b4-49bf-4695-bb79-b9296c4216a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:08:59.982226 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc7b4-49bf-4695-bb79-b9296c4216a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:08:59.982500 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc7b4-49bf-4695-bb79-b9296c4216a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:08:59.983183 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc7b4-49bf-4695-bb79-b9296c4216a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:08:59.985078 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc7b4-49bf-4695-bb79-b9296c4216a7 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:00.009962 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1410/2848] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:08:59 2022] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:09:00.013372 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36715db0-bbfc-4ad2-8e57-4c5b5dbbc938 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:00.023089 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36715db0-bbfc-4ad2-8e57-4c5b5dbbc938 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:00.077305 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb29983-fd14-4edc-884f-c452b6d5d1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:00.077988 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb29983-fd14-4edc-884f-c452b6d5d1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:00.078276 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb29983-fd14-4edc-884f-c452b6d5d1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:00.078553 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb29983-fd14-4edc-884f-c452b6d5d1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:00.079230 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb29983-fd14-4edc-884f-c452b6d5d1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:00.081134 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb29983-fd14-4edc-884f-c452b6d5d1a6 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:00.100637 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1439/2849] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:09:00 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:09:00.105205 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc7b4-49bf-4695-bb79-b9296c4216a7 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:00.115241 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc7b4-49bf-4695-bb79-b9296c4216a7 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:00.119973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf51b8-fce0-412f-b3fd-87284bbd7eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:00.121147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf51b8-fce0-412f-b3fd-87284bbd7eae admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:00.121431 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf51b8-fce0-412f-b3fd-87284bbd7eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:00.121749 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf51b8-fce0-412f-b3fd-87284bbd7eae admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:00.122477 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf51b8-fce0-412f-b3fd-87284bbd7eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:00.124061 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf51b8-fce0-412f-b3fd-87284bbd7eae admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:00.134626 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1411/2850] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:09:00.138806 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb29983-fd14-4edc-884f-c452b6d5d1a6 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:00.148633 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb29983-fd14-4edc-884f-c452b6d5d1a6 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:00.153178 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ee64d-5792-404c-9fc4-6c53c040dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:00.153860 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ee64d-5792-404c-9fc4-6c53c040dc55 admin admin] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:00.154139 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ee64d-5792-404c-9fc4-6c53c040dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:00.154411 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ee64d-5792-404c-9fc4-6c53c040dc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:00.155149 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ee64d-5792-404c-9fc4-6c53c040dc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:00.156719 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ee64d-5792-404c-9fc4-6c53c040dc55 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:00.168815 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1440/2851] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:09:00.170816 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf51b8-fce0-412f-b3fd-87284bbd7eae admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:00.180688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf51b8-fce0-412f-b3fd-87284bbd7eae admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:00.185853 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa92ca-2ba0-4565-b839-0a3021503e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:00.186713 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa92ca-2ba0-4565-b839-0a3021503e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:00.186994 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa92ca-2ba0-4565-b839-0a3021503e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:00.187273 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa92ca-2ba0-4565-b839-0a3021503e32 admin admin] PATH_INFO: `/v3/projects/0565eaa27c9a44e18a307c563a51767f/users/07563e344f8c439ea8d2439c61729d95/roles/4a765555b657413ea79721175a7191e3` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:00.201281 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa92ca-2ba0-4565-b839-0a3021503e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0565eaa27c9a44e18a307c563a51767f, user_id=07563e344f8c439ea8d2439c61729d95, role_id=4a765555b657413ea79721175a7191e3)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:00.203932 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa92ca-2ba0-4565-b839-0a3021503e32 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:00.216220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1412/2852] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:09:00 2022] PUT /identity/v3/projects/0565eaa27c9a44e18a307c563a51767f/users/07563e344f8c439ea8d2439c61729d95/roles/4a765555b657413ea79721175a7191e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:09:00.221136 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac02dfb-e88f-48b4-8130-cc22f99799aa None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:00.221431 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac02dfb-e88f-48b4-8130-cc22f99799aa None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:00.221742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac02dfb-e88f-48b4-8130-cc22f99799aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:00.239445 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-fac02dfb-e88f-48b4-8130-cc22f99799aa None None] MFA Rules not processed for user `39e02c8648054bf7b77e58c3e22a7e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:09:00.240631 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-fac02dfb-e88f-48b4-8130-cc22f99799aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:00.296767 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1441/2853] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:09:00.306367 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa92ca-2ba0-4565-b839-0a3021503e32 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:00.308849 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-6cfa92ca-2ba0-4565-b839-0a3021503e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:00.366504 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa92ca-2ba0-4565-b839-0a3021503e32 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:00.370218 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9d41b-e6a8-42c9-9280-32317cd12fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:00.371406 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9d41b-e6a8-42c9-9280-32317cd12fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:00.371684 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9d41b-e6a8-42c9-9280-32317cd12fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:00.371959 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9d41b-e6a8-42c9-9280-32317cd12fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:00.380705 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9d41b-e6a8-42c9-9280-32317cd12fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:00.382171 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9d41b-e6a8-42c9-9280-32317cd12fc7 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:00.391422 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1413/2854] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 19:09:04.300991 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bd6c-195d-4d7a-84bd-f725d86c5069 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:04.301498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bd6c-195d-4d7a-84bd-f725d86c5069 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:04.301640 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bd6c-195d-4d7a-84bd-f725d86c5069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:04.328658 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-7262bd6c-195d-4d7a-84bd-f725d86c5069 None None] MFA Rules not processed for user `07563e344f8c439ea8d2439c61729d95`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:09:04.329995 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-7262bd6c-195d-4d7a-84bd-f725d86c5069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:04.395364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1442/2855] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:09:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:09:04.399919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9d41b-e6a8-42c9-9280-32317cd12fc7 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:04.409879 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9d41b-e6a8-42c9-9280-32317cd12fc7 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:04.414492 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a364bbd-2e45-489c-be12-24fc16ac0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:04.415147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a364bbd-2e45-489c-be12-24fc16ac0ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:04.415430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a364bbd-2e45-489c-be12-24fc16ac0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:04.415706 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a364bbd-2e45-489c-be12-24fc16ac0ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:04.416404 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a364bbd-2e45-489c-be12-24fc16ac0ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:04.418386 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a364bbd-2e45-489c-be12-24fc16ac0ec2 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:04.444034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1414/2856] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 12 19:09:04 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 19:09:04.448140 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262bd6c-195d-4d7a-84bd-f725d86c5069 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:04.459507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262bd6c-195d-4d7a-84bd-f725d86c5069 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:04.517769 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfbf7-42ef-431f-be6f-0e593a63043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:04.518447 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfbf7-42ef-431f-be6f-0e593a63043d admin admin] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:04.518734 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfbf7-42ef-431f-be6f-0e593a63043d admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:04.519012 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfbf7-42ef-431f-be6f-0e593a63043d admin admin] PATH_INFO: `/v3/users` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:04.519725 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cfbf7-42ef-431f-be6f-0e593a63043d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:04.521966 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cfbf7-42ef-431f-be6f-0e593a63043d admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:04.547041 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1443/2857] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 12 19:09:04 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 19:09:04.548329 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a364bbd-2e45-489c-be12-24fc16ac0ec2 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:04.559200 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a364bbd-2e45-489c-be12-24fc16ac0ec2 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:04.567740 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90f88e-70d4-4a76-a7cb-fc1c3933c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:04.568410 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90f88e-70d4-4a76-a7cb-fc1c3933c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:04.568692 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90f88e-70d4-4a76-a7cb-fc1c3933c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:04.568979 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90f88e-70d4-4a76-a7cb-fc1c3933c0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:04.569738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90f88e-70d4-4a76-a7cb-fc1c3933c0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:04.571370 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90f88e-70d4-4a76-a7cb-fc1c3933c0ff admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:04.583425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1415/2858] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 19:09:04.587609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfbf7-42ef-431f-be6f-0e593a63043d admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:04.598880 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfbf7-42ef-431f-be6f-0e593a63043d admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:04.603589 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6bbb1-c55a-41b6-97f9-608ac3e291d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:04.604493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6bbb1-c55a-41b6-97f9-608ac3e291d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:04.604778 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6bbb1-c55a-41b6-97f9-608ac3e291d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:04.605054 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6bbb1-c55a-41b6-97f9-608ac3e291d5 admin admin] PATH_INFO: `/v3/projects/d46fb85fd18b4512821af35cdc5e62e6/users/b8acbb8b6b2346f8b6bd01e7d6dc9370/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:04.620248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6bbb1-c55a-41b6-97f9-608ac3e291d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46fb85fd18b4512821af35cdc5e62e6, user_id=b8acbb8b6b2346f8b6bd01e7d6dc9370, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:04.622945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6bbb1-c55a-41b6-97f9-608ac3e291d5 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:04.636393 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1444/2859] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:09:04 2022] PUT /identity/v3/projects/d46fb85fd18b4512821af35cdc5e62e6/users/b8acbb8b6b2346f8b6bd01e7d6dc9370/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:09:04.640889 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90f88e-70d4-4a76-a7cb-fc1c3933c0ff admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:04.651568 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90f88e-70d4-4a76-a7cb-fc1c3933c0ff admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:04.734075 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1f9cc-bb9f-43b4-85a9-5bf5f537c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:04.734783 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1f9cc-bb9f-43b4-85a9-5bf5f537c764 admin admin] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:04.735065 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1f9cc-bb9f-43b4-85a9-5bf5f537c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:04.735339 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1f9cc-bb9f-43b4-85a9-5bf5f537c764 admin admin] PATH_INFO: `/v3/roles` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:04.736072 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1f9cc-bb9f-43b4-85a9-5bf5f537c764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:04.737743 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1f9cc-bb9f-43b4-85a9-5bf5f537c764 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:04.748799 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1416/2860] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 12 19:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 19:09:04.753250 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6bbb1-c55a-41b6-97f9-608ac3e291d5 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:04.764851 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6bbb1-c55a-41b6-97f9-608ac3e291d5 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:04.769635 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc675660-590c-450e-a614-25bc0758cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:04.770522 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc675660-590c-450e-a614-25bc0758cd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:04.770802 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc675660-590c-450e-a614-25bc0758cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:04.771075 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc675660-590c-450e-a614-25bc0758cd67 admin admin] PATH_INFO: `/v3/projects/d46fb85fd18b4512821af35cdc5e62e6/users/b8acbb8b6b2346f8b6bd01e7d6dc9370/roles/d03e020b3fb34446bbf5893b28904483` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:04.773156 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc675660-590c-450e-a614-25bc0758cd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46fb85fd18b4512821af35cdc5e62e6, user_id=b8acbb8b6b2346f8b6bd01e7d6dc9370, role_id=d03e020b3fb34446bbf5893b28904483)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:04.776114 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc675660-590c-450e-a614-25bc0758cd67 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:04.787937 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1445/2861] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 12 19:09:04 2022] PUT /identity/v3/projects/d46fb85fd18b4512821af35cdc5e62e6/users/b8acbb8b6b2346f8b6bd01e7d6dc9370/roles/d03e020b3fb34446bbf5893b28904483 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:09:09.256337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d5b0-0014-402a-9411-d2976a2193c4 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:09.256790 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d5b0-0014-402a-9411-d2976a2193c4 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:09.256891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d5b0-0014-402a-9411-d2976a2193c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:09.295800 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-a760d5b0-0014-402a-9411-d2976a2193c4 None None] MFA Rules not processed for user `b8acbb8b6b2346f8b6bd01e7d6dc9370`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:09:09.297104 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-a760d5b0-0014-402a-9411-d2976a2193c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:09.366113 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1417/2862] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:09:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:09:09.380270 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc675660-590c-450e-a614-25bc0758cd67 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:09.382217 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-dc675660-590c-450e-a614-25bc0758cd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:09.455755 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc675660-590c-450e-a614-25bc0758cd67 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:09.461188 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a9ce-3f01-4779-a7db-4bb7d53e9879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:09.461870 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a9ce-3f01-4779-a7db-4bb7d53e9879 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:09.462154 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a9ce-3f01-4779-a7db-4bb7d53e9879 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:09.462432 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a9ce-3f01-4779-a7db-4bb7d53e9879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:09.516594 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849a9ce-3f01-4779-a7db-4bb7d53e9879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:09.518389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849a9ce-3f01-4779-a7db-4bb7d53e9879 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:09.527562 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1446/2863] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:09:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:09:10.710948 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26f82a-f4be-47b1-a000-2dff1aee33e0 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:10.711846 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26f82a-f4be-47b1-a000-2dff1aee33e0 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:10.712135 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26f82a-f4be-47b1-a000-2dff1aee33e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:10.730011 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-3f26f82a-f4be-47b1-a000-2dff1aee33e0 None None] MFA Rules not processed for user `07563e344f8c439ea8d2439c61729d95`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:09:10.731216 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-3f26f82a-f4be-47b1-a000-2dff1aee33e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:10.738244 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1418/2864] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:09:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:09:18.079350 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a9ce-3f01-4779-a7db-4bb7d53e9879 service nova] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:18.132694 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a9ce-3f01-4779-a7db-4bb7d53e9879 service nova] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:18.136231 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924b406-deb3-40ff-a10f-7cf862092db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:18.136866 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b406-deb3-40ff-a10f-7cf862092db6 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:18.137142 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b406-deb3-40ff-a10f-7cf862092db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:18.137412 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b406-deb3-40ff-a10f-7cf862092db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:18.139315 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3924b406-deb3-40ff-a10f-7cf862092db6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:18.153448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924b406-deb3-40ff-a10f-7cf862092db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:18.154968 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924b406-deb3-40ff-a10f-7cf862092db6 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:18.165780 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1447/2865] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:09:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:09:19.354983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26f82a-f4be-47b1-a000-2dff1aee33e0 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:19.364869 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26f82a-f4be-47b1-a000-2dff1aee33e0 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:19.368797 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:19.369475 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:19.369791 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:19.370064 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:19.371862 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:19.385964 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:19.387390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:19.398777 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1419/2866] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:09:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:09:21.702686 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6ad48-6c9e-4bc3-bfad-f795da8dc6f9 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:21.703155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6ad48-6c9e-4bc3-bfad-f795da8dc6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:21.703273 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6ad48-6c9e-4bc3-bfad-f795da8dc6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:21.719739 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-4ab6ad48-6c9e-4bc3-bfad-f795da8dc6f9 None None] MFA Rules not processed for user `6cf36b056ece466ea23001b8d33c16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:09:21.720899 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4ab6ad48-6c9e-4bc3-bfad-f795da8dc6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:21.775984 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1448/2867] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 12 19:09:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:09:21.816570 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:21.818032 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:21.883103 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398684e-abb5-4de1-bafd-c48f5c55a236 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:21.887850 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db89e52-b472-4f2c-b839-99d0b2d7030a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84eb7224717643288cc61f8e6f901543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:21.888506 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db89e52-b472-4f2c-b839-99d0b2d7030a service swift] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:21.888786 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db89e52-b472-4f2c-b839-99d0b2d7030a service swift] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:21.889063 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db89e52-b472-4f2c-b839-99d0b2d7030a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:21.897259 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db89e52-b472-4f2c-b839-99d0b2d7030a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:21.898865 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db89e52-b472-4f2c-b839-99d0b2d7030a service swift] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:21.906841 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1420/2868] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 12 19:09:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 19:09:29.031839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6ad48-6c9e-4bc3-bfad-f795da8dc6f9 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:29.033220 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-4ab6ad48-6c9e-4bc3-bfad-f795da8dc6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:29.108323 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6ad48-6c9e-4bc3-bfad-f795da8dc6f9 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:29.114354 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:29.116628 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:29.116919 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:29.117194 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] PATH_INFO: `/v3/users/345b44fe3ae849fb8f0a529d33e64679` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:29.118598 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] RBAC: Authorizing `identity:delete_user(user_id=345b44fe3ae849fb8f0a529d33e64679)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:29.121216 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:29.177072 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345b44fe3ae849fb8f0a529d33e64679'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.177852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345b44fe3ae849fb8f0a529d33e64679'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.195162 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345b44fe3ae849fb8f0a529d33e64679'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.196207 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345b44fe3ae849fb8f0a529d33e64679'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.207219 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345b44fe3ae849fb8f0a529d33e64679'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.224135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1449/2869] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:09:29 2022] DELETE /identity/v3/users/345b44fe3ae849fb8f0a529d33e64679 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:09:29.427698 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db89e52-b472-4f2c-b839-99d0b2d7030a service swift] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:29.439720 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db89e52-b472-4f2c-b839-99d0b2d7030a service swift] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:29.504219 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:29.505164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:29.505515 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:29.505916 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] PATH_INFO: `/v3/projects/ac196e75b746478c8ca28495d0971916` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:29.507317 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac196e75b746478c8ca28495d0971916)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:29.509913 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:29.558998 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac196e75b746478c8ca28495d0971916', 'request_id': 'req-b9105723-02bb-4bd5-8f1b-537e5b315afb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.570496 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac196e75b746478c8ca28495d0971916', 'request_id': 'req-b9105723-02bb-4bd5-8f1b-537e5b315afb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.577195 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac196e75b746478c8ca28495d0971916', 'request_id': 'req-b9105723-02bb-4bd5-8f1b-537e5b315afb'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.589928 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] The token cache is being invalidate because project ac196e75b746478c8ca28495d0971916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:09:29.590303 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.591014 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.592616 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1421/2870] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:09:29 2022] DELETE /identity/v3/projects/ac196e75b746478c8ca28495d0971916 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:09:29.596595 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:29.598065 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:29.612448 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6abd34-4a6f-45ab-9bb5-9b288ff0600e admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:29.680078 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:29.683296 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:29.683650 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:29.684001 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] PATH_INFO: `/v3/users/26a33fd920a941df96f487abade2b8f6` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:29.685400 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a33fd920a941df96f487abade2b8f6)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:29.690132 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:29.751097 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a33fd920a941df96f487abade2b8f6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.751798 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a33fd920a941df96f487abade2b8f6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.765248 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a33fd920a941df96f487abade2b8f6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.766525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a33fd920a941df96f487abade2b8f6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.774953 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a33fd920a941df96f487abade2b8f6'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:29.788228 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1450/2871] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:09:29 2022] DELETE /identity/v3/users/26a33fd920a941df96f487abade2b8f6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:09:30.498529 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:30.500265 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:30.514731 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9105723-02bb-4bd5-8f1b-537e5b315afb admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:30.583112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:30.584114 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:30.584455 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:30.584738 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] PATH_INFO: `/v3/projects/10202842bca14ed8b384ceca7724b8b6` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:30.585956 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10202842bca14ed8b384ceca7724b8b6)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:30.587877 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:30.633453 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10202842bca14ed8b384ceca7724b8b6', 'request_id': 'req-5fddea0a-af17-4f64-8b2b-b54347d22660'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:30.641239 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10202842bca14ed8b384ceca7724b8b6', 'request_id': 'req-5fddea0a-af17-4f64-8b2b-b54347d22660'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:30.647034 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10202842bca14ed8b384ceca7724b8b6', 'request_id': 'req-5fddea0a-af17-4f64-8b2b-b54347d22660'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:30.658079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] The token cache is being invalidate because project 10202842bca14ed8b384ceca7724b8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:09:30.658359 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:30.659168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-5fddea0a-af17-4f64-8b2b-b54347d22660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:09:30.660739 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1422/2872] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:09:30 2022] DELETE /identity/v3/projects/10202842bca14ed8b384ceca7724b8b6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:09:42.703894 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:09:42.705973 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:42.762094 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b9efa-3bc4-46e2-ad30-88d6de349ac4 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:09:42.807737 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:09:42.808371 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:09:42.808651 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:09:42.808922 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:09:42.810697 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:09:42.870550 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:09:42.872003 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:09:42.881992 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1451/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:09:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:10:13.738542 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7784b-1ee4-4311-8fd3-fb3ec555f257 None None] REQUEST_METHOD: `POST` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:10:13.739112 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7784b-1ee4-4311-8fd3-fb3ec555f257 None None] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:10:13.739337 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7784b-1ee4-4311-8fd3-fb3ec555f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:10:13.759983 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.auth.core [None req-00a7784b-1ee4-4311-8fd3-fb3ec555f257 None None] MFA Rules not processed for user `dfae4bc82b774dc1bb8c98990b6a4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=79833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:10:13.761292 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00a7784b-1ee4-4311-8fd3-fb3ec555f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:10:13.816660 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1423/2874] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:10:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:10:14.557960 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:10:14.559515 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:10:14.628005 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebf21c-d91d-49f1-bbd1-80be66b73c28 service neutron] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:10:14.633493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf772e34d8f14923bb9c1fe883fd3926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:10:14.634179 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:10:14.634474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:10:14.634727 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:10:14.636474 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:10:14.648320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:10:14.649940 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:10:14.659534 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1452/2875] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:10:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:10:16.488674 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7784b-1ee4-4311-8fd3-fb3ec555f257 None None] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:10:16.490316 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-00a7784b-1ee4-4311-8fd3-fb3ec555f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:10:16.502785 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7784b-1ee4-4311-8fd3-fb3ec555f257 None None] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:10:16.506641 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8d091-e703-4008-aa47-aa68d808370e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:10:16.507306 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8d091-e703-4008-aa47-aa68d808370e service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:10:16.507587 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8d091-e703-4008-aa47-aa68d808370e service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:10:16.507859 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8d091-e703-4008-aa47-aa68d808370e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:10:16.509803 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-fdb8d091-e703-4008-aa47-aa68d808370e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:10:16.520551 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8d091-e703-4008-aa47-aa68d808370e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:10:16.522638 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8d091-e703-4008-aa47-aa68d808370e service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:10:16.531829 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1424/2876] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:10:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:10:28.827232 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:10:28.828668 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:10:28.901252 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2c3a-cdce-484d-9ad9-9d7236f4a87c service placement] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:10:28.906660 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a0ad4-4a73-4cd4-bdc5-2346377f1f99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:10:28.907329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a0ad4-4a73-4cd4-bdc5-2346377f1f99 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:10:28.907611 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a0ad4-4a73-4cd4-bdc5-2346377f1f99 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:10:28.907885 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a0ad4-4a73-4cd4-bdc5-2346377f1f99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:10:28.909643 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-897a0ad4-4a73-4cd4-bdc5-2346377f1f99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:10:28.922111 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a0ad4-4a73-4cd4-bdc5-2346377f1f99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:10:28.923671 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a0ad4-4a73-4cd4-bdc5-2346377f1f99 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:10:28.934561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1453/2877] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:10:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:10:33.048157 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8d091-e703-4008-aa47-aa68d808370e service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:10:33.061381 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8d091-e703-4008-aa47-aa68d808370e service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:10:33.066942 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:10:33.067607 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:10:33.067891 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:10:33.068167 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:10:33.070026 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:10:33.082809 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:10:33.084469 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:10:33.096421 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1425/2878] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:10:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:11:54.571836 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a0ad4-4a73-4cd4-bdc5-2346377f1f99 service nova] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:11:54.610420 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a0ad4-4a73-4cd4-bdc5-2346377f1f99 service nova] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:11:54.614459 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a669c0e-f3bf-4920-bf9a-75cb4e53a43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:11:54.615293 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a669c0e-f3bf-4920-bf9a-75cb4e53a43a service neutron] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:11:54.615442 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a669c0e-f3bf-4920-bf9a-75cb4e53a43a service neutron] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:11:54.615641 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a669c0e-f3bf-4920-bf9a-75cb4e53a43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:11:54.617501 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2a669c0e-f3bf-4920-bf9a-75cb4e53a43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:11:54.650388 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a669c0e-f3bf-4920-bf9a-75cb4e53a43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:11:54.651852 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a669c0e-f3bf-4920-bf9a-75cb4e53a43a service neutron] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:11:54.660789 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1454/2879] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:11:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:11:54.767586 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:11:54.768988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:11:54.809429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef295734-b7df-47bd-9178-c9c08e629545 service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:11:54.812915 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32451d-16b9-4d11-963f-c2e141bcdad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:11:54.813566 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32451d-16b9-4d11-963f-c2e141bcdad6 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:11:54.813852 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32451d-16b9-4d11-963f-c2e141bcdad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:11:54.814121 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32451d-16b9-4d11-963f-c2e141bcdad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:11:54.815851 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-8b32451d-16b9-4d11-963f-c2e141bcdad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:11:54.848630 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32451d-16b9-4d11-963f-c2e141bcdad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:11:54.850091 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32451d-16b9-4d11-963f-c2e141bcdad6 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:11:54.861326 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1426/2880] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:11:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:12:07.096443 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d0a05-5341-4a91-840e-1cfc68c97e54 None None] REQUEST_METHOD: `POST` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:12:07.096946 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d0a05-5341-4a91-840e-1cfc68c97e54 None None] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:12:07.097077 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d0a05-5341-4a91-840e-1cfc68c97e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:12:07.113570 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.auth.core [None req-f75d0a05-5341-4a91-840e-1cfc68c97e54 None None] MFA Rules not processed for user `dfae4bc82b774dc1bb8c98990b6a4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=79834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 19:12:07.114749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-f75d0a05-5341-4a91-840e-1cfc68c97e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:12:07.121559 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1455/2881] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 12 19:12:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 19:12:07.442425 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32451d-16b9-4d11-963f-c2e141bcdad6 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:12:07.451098 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32451d-16b9-4d11-963f-c2e141bcdad6 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:12:07.455378 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ef952-34eb-420d-8051-0b203e3e5dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:12:07.456015 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ef952-34eb-420d-8051-0b203e3e5dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:12:07.456302 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ef952-34eb-420d-8051-0b203e3e5dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:12:07.456581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ef952-34eb-420d-8051-0b203e3e5dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:12:07.458363 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ec5ef952-34eb-420d-8051-0b203e3e5dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:12:07.467634 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ef952-34eb-420d-8051-0b203e3e5dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:12:07.469055 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ef952-34eb-420d-8051-0b203e3e5dd6 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:12:07.476923 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1427/2882] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:12:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:12:20.691280 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d0a05-5341-4a91-840e-1cfc68c97e54 None None] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:12:20.720954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d0a05-5341-4a91-840e-1cfc68c97e54 None None] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:12:20.726418 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb895bf-d082-448f-98f9-930b7a2d9584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:12:20.727048 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb895bf-d082-448f-98f9-930b7a2d9584 service nova] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:12:20.727333 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb895bf-d082-448f-98f9-930b7a2d9584 service nova] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:12:20.727609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb895bf-d082-448f-98f9-930b7a2d9584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:12:20.729345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-0bb895bf-d082-448f-98f9-930b7a2d9584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:12:20.739785 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb895bf-d082-448f-98f9-930b7a2d9584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:12:20.741364 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb895bf-d082-448f-98f9-930b7a2d9584 service nova] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:12:20.749958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1456/2883] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:12:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:13:20.825428 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ef952-34eb-420d-8051-0b203e3e5dd6 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:13:20.839369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ef952-34eb-420d-8051-0b203e3e5dd6 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:13:20.845369 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e41b41f355446c8462fafcd91c183f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:13:20.846207 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:13:20.846593 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:13:20.846871 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:13:20.848685 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:13:20.873164 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:13:20.875137 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:13:20.889144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1428/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:13:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:13:23.840913 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb895bf-d082-448f-98f9-930b7a2d9584 service nova] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:13:23.861702 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb895bf-d082-448f-98f9-930b7a2d9584 service nova] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:13:23.867126 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb25eb6-dd8d-432e-9ff0-078b632ade9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf772e34d8f14923bb9c1fe883fd3926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:13:23.867757 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb25eb6-dd8d-432e-9ff0-078b632ade9e service placement] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:13:23.868040 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb25eb6-dd8d-432e-9ff0-078b632ade9e service placement] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:13:23.868320 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb25eb6-dd8d-432e-9ff0-078b632ade9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:13:23.870272 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-2fb25eb6-dd8d-432e-9ff0-078b632ade9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:13:23.893423 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb25eb6-dd8d-432e-9ff0-078b632ade9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:13:23.895031 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb25eb6-dd8d-432e-9ff0-078b632ade9e service placement] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:13:23.904772 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1457/2885] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:13:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:13:30.950866 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:13:30.952318 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:13:31.050497 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2d50d-b07f-487e-b2e7-5edbfea9b206 service nova] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:13:31.055305 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:13:31.056181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:13:31.056447 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:13:31.056723 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] PATH_INFO: `/v3/users/07563e344f8c439ea8d2439c61729d95` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:13:31.057934 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07563e344f8c439ea8d2439c61729d95)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:13:31.059840 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:13:31.105973 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07563e344f8c439ea8d2439c61729d95'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.117277 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07563e344f8c439ea8d2439c61729d95'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.124278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07563e344f8c439ea8d2439c61729d95'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.124988 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07563e344f8c439ea8d2439c61729d95'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.134176 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07563e344f8c439ea8d2439c61729d95'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.140737 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1429/2886] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:13:30 2022] DELETE /identity/v3/users/07563e344f8c439ea8d2439c61729d95 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:13:31.312945 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb25eb6-dd8d-432e-9ff0-078b632ade9e service placement] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:13:31.324583 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb25eb6-dd8d-432e-9ff0-078b632ade9e service placement] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:13:31.391891 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:13:31.392746 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:13:31.393031 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:13:31.393306 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] PATH_INFO: `/v3/projects/0565eaa27c9a44e18a307c563a51767f` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:13:31.394516 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0565eaa27c9a44e18a307c563a51767f)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:13:31.397009 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:13:31.444793 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0565eaa27c9a44e18a307c563a51767f', 'request_id': 'req-8557b592-cb03-41bc-ac2c-8c39ff624fea'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.451348 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0565eaa27c9a44e18a307c563a51767f', 'request_id': 'req-8557b592-cb03-41bc-ac2c-8c39ff624fea'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.457867 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0565eaa27c9a44e18a307c563a51767f', 'request_id': 'req-8557b592-cb03-41bc-ac2c-8c39ff624fea'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.467720 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] The token cache is being invalidate because project 0565eaa27c9a44e18a307c563a51767f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:13:31.468009 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.468659 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.470251 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1458/2887] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:13:31 2022] DELETE /identity/v3/projects/0565eaa27c9a44e18a307c563a51767f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:13:31.474220 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:13:31.475637 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:13:31.489263 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a1405-7ae3-442f-a51d-3b561c84ba90 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:13:31.542430 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:13:31.543295 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:13:31.543574 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:13:31.543848 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] PATH_INFO: `/v3/users/b8acbb8b6b2346f8b6bd01e7d6dc9370` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:13:31.545016 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8acbb8b6b2346f8b6bd01e7d6dc9370)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:13:31.546971 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:13:31.590278 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8acbb8b6b2346f8b6bd01e7d6dc9370'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.601388 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8acbb8b6b2346f8b6bd01e7d6dc9370'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.607861 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8acbb8b6b2346f8b6bd01e7d6dc9370'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.608514 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8acbb8b6b2346f8b6bd01e7d6dc9370'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.615858 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8acbb8b6b2346f8b6bd01e7d6dc9370'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.621581 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1430/2888] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:13:31 2022] DELETE /identity/v3/users/b8acbb8b6b2346f8b6bd01e7d6dc9370 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:13:31.796609 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:13:31.798345 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:13:31.811771 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b592-cb03-41bc-ac2c-8c39ff624fea admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:13:31.867974 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:13:31.868823 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:13:31.869117 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:13:31.869391 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] PATH_INFO: `/v3/projects/d46fb85fd18b4512821af35cdc5e62e6` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:13:31.870601 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46fb85fd18b4512821af35cdc5e62e6)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:13:31.872493 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:13:31.915889 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46fb85fd18b4512821af35cdc5e62e6', 'request_id': 'req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.922818 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46fb85fd18b4512821af35cdc5e62e6', 'request_id': 'req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.929648 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46fb85fd18b4512821af35cdc5e62e6', 'request_id': 'req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.939498 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] The token cache is being invalidate because project d46fb85fd18b4512821af35cdc5e62e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:13:31.939783 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.940421 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:13:31.942079 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1459/2889] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:13:31 2022] DELETE /identity/v3/projects/d46fb85fd18b4512821af35cdc5e62e6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:14:19.317184 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:14:19.318664 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:14:19.391101 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8355cc-6ba0-4d66-b5d5-560cf70a189e admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:14:19.446643 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086e73b-0d7d-4470-a6a1-72bf5bde2860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41938583e61a45398e3e284c70204292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:14:19.447001 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086e73b-0d7d-4470-a6a1-72bf5bde2860 service neutron] REQUEST_METHOD: `GET` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:14:19.447144 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086e73b-0d7d-4470-a6a1-72bf5bde2860 service neutron] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:14:19.447347 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086e73b-0d7d-4470-a6a1-72bf5bde2860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:14:19.449919 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-f086e73b-0d7d-4470-a6a1-72bf5bde2860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:14:19.511838 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086e73b-0d7d-4470-a6a1-72bf5bde2860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:14:19.513188 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086e73b-0d7d-4470-a6a1-72bf5bde2860 service neutron] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:14:19.522688 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1431/2890] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 19:14:25.894749 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:14:25.896308 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:14:25.909839 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268a00a-24c3-4bf7-a0b0-2aed05b1cfdf admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:14:25.915062 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:14:25.916140 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:14:25.916453 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:14:25.916731 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] PATH_INFO: `/v3/users/dfae4bc82b774dc1bb8c98990b6a4ac7` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:14:25.917994 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfae4bc82b774dc1bb8c98990b6a4ac7)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:14:25.920064 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:14:25.964302 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfae4bc82b774dc1bb8c98990b6a4ac7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:25.964954 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfae4bc82b774dc1bb8c98990b6a4ac7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:25.976389 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfae4bc82b774dc1bb8c98990b6a4ac7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:25.977513 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfae4bc82b774dc1bb8c98990b6a4ac7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:25.984329 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfae4bc82b774dc1bb8c98990b6a4ac7'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:25.996525 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1460/2891] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:14:25 2022] DELETE /identity/v3/users/dfae4bc82b774dc1bb8c98990b6a4ac7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 19:14:26.165217 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086e73b-0d7d-4470-a6a1-72bf5bde2860 service neutron] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:14:26.175312 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086e73b-0d7d-4470-a6a1-72bf5bde2860 service neutron] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:14:26.232045 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:14:26.232894 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:14:26.233181 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:14:26.233457 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] PATH_INFO: `/v3/projects/ab7dbf84e4d74021b021fbf20b99a7c9` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:14:26.234667 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7dbf84e4d74021b021fbf20b99a7c9)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:14:26.236579 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:14:26.279695 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'request_id': 'req-89b73221-e5d5-415b-bd84-e1a8898d6a28'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.286486 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'request_id': 'req-89b73221-e5d5-415b-bd84-e1a8898d6a28'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.292390 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'request_id': 'req-89b73221-e5d5-415b-bd84-e1a8898d6a28'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.302793 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] The token cache is being invalidate because project ab7dbf84e4d74021b021fbf20b99a7c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:14:26.303079 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.303700 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.305384 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1432/2892] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:14:26 2022] DELETE /identity/v3/projects/ab7dbf84e4d74021b021fbf20b99a7c9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:14:26.309623 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:14:26.311023 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:14:26.323724 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519b2a-9a08-4195-953c-ab10197d97c3 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:14:26.378879 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:14:26.379742 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:14:26.380027 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:14:26.380298 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] PATH_INFO: `/v3/users/744d92a902f54353a8214e9d362a77ec` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:14:26.381469 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744d92a902f54353a8214e9d362a77ec)` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:14:26.383958 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:14:26.427561 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744d92a902f54353a8214e9d362a77ec'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.428135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744d92a902f54353a8214e9d362a77ec'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.440507 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744d92a902f54353a8214e9d362a77ec'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.441135 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744d92a902f54353a8214e9d362a77ec'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.448473 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.notifications [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744d92a902f54353a8214e9d362a77ec'} {{(pid=79834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.460229 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1461/2893] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 12 19:14:26 2022] DELETE /identity/v3/users/744d92a902f54353a8214e9d362a77ec => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:14:26.628189 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] Authenticating user token {{(pid=79833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:14:26.629649 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.fernet_utils [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:14:26.645808 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73221-e5d5-415b-bd84-e1a8898d6a28 admin admin] Validating token access rules against request {{(pid=79833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:14:26.703382 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e02c8648054bf7b77e58c3e22a7e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '039d8e8cc62f44a2bdf4d5f5334c1312', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:14:26.704235 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:14:26.704518 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:14:26.704794 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] PATH_INFO: `/v3/projects/8f0cc8e0097e4b8ea23d639b32dc9d71` {{(pid=79833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:14:26.705984 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0cc8e0097e4b8ea23d639b32dc9d71)` {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:14:26.707874 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] RBAC: Authorization granted {{(pid=79833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:14:26.751213 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0cc8e0097e4b8ea23d639b32dc9d71', 'request_id': 'req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.758168 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0cc8e0097e4b8ea23d639b32dc9d71', 'request_id': 'req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.763613 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0cc8e0097e4b8ea23d639b32dc9d71', 'request_id': 'req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9'} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.774147 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] The token cache is being invalidate because project 8f0cc8e0097e4b8ea23d639b32dc9d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 19:14:26.774429 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.775046 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: DEBUG keystone.notifications [None req-b08e1fc9-0cb3-4ce6-abee-56f55c1d5da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 19:14:26.776594 dv-cinder-795751-3-iscsi devstack@keystone.service[79833]: [pid: 79833|app: 0|req: 1433/2894] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 12 19:14:26 2022] DELETE /identity/v3/projects/8f0cc8e0097e4b8ea23d639b32dc9d71 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 19:18:33.118761 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] Authenticating user token {{(pid=79834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 19:18:33.120191 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:18:33.187038 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1241294-920f-415b-a81f-72e34ac48576 admin admin] Validating token access rules against request {{(pid=79834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 19:18:33.245155 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198b6d-2589-4b23-bff8-1a98f52587d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf772e34d8f14923bb9c1fe883fd3926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8193b8e19212476c8674b59794861c32', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 19:18:33.245838 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198b6d-2589-4b23-bff8-1a98f52587d7 service placement] REQUEST_METHOD: `GET` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 19:18:33.246122 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198b6d-2589-4b23-bff8-1a98f52587d7 service placement] SCRIPT_NAME: `/identity` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 19:18:33.246395 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198b6d-2589-4b23-bff8-1a98f52587d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 19:18:33.248148 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.fernet_utils [None req-d0198b6d-2589-4b23-bff8-1a98f52587d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 19:18:33.259049 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198b6d-2589-4b23-bff8-1a98f52587d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 19:18:33.260617 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198b6d-2589-4b23-bff8-1a98f52587d7 service placement] RBAC: Authorization granted {{(pid=79834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 19:18:33.270715 dv-cinder-795751-3-iscsi devstack@keystone.service[79834]: [pid: 79834|app: 0|req: 1462/2895] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 12 19:18:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)